Step n Sound

Nov 2022

Nov 2022

Interaction design

Interaction design

Visual design

Visual design

VR development

VR development

Sound design

Sound design

Unity

Unity

Figma

Figma

Ableton

Ableton

Step n Sound is a 3D sequencer with multiple zones for placing sound objects. The scene features four 8-step sequencers represented by blue (inactive) and green (active) boxes. Users create sound objects via buttons on a panel, and these objects appear above a platform.


Using the grips, users can place objects in sequencer boxes; when a box turns green, the corresponding sound plays. Objects can also be destroyed by holding them and pressing the X button on the left controller. A slider on the panel adjusts the BPM of all sequencers.



The demo video

Opportunities for Musical Expression


The design introduces a new approach to musical expression, exploring the relationship between sound and space. Spatial sound is intuitively created within the 3D environment, making music creation enjoyable. The project also considers motion and tactile interactions—such as touching, grabbing, and moving—as inputs, expanding beyond traditional interfaces and methods of music creation or performance. Using lighting, shapes, colors, objects, and interactions, it seeks metaphors that align with musical expression in a virtual 3D space.


© 2024 Zejun Wu

zejunwudesign@gmail.com

© 2024 Zejun Wu

zejunwudesign@gmail.com

© 2024 Zejun Wu

zejunwudesign@gmail.com