MORNING
LOADING DATA…
DISPLAY MODE
GAME VIEW
DATA FILTER
TRACKER ROLES
PROJECTION EDIT
OFF
ON
INPUT MODE
INTERACT CAMERA
CAMERA SOURCE
TOOLS
TRACKING SENSITIVITY
COLOR DIST 50
GAMEPLAY RULES
  • • Core Objective: Two players race from the Start Zone (Green) to the Finish Zone (Red). The winner is the player with the lowest cumulative noise penalty in dB.
  • • Game Setup & Environment: The field is a 7 x 5 coordinate grid with 35 cells. All players must begin on the Green START cell, and each player begins at 0.0 dB.
  • • Movement & Mechanics: Play is turn-based, and the board stays blind until a player lands on a cell. The revealed sensor dB is added to that player’s cumulative score, and players must complete at least 10 moves before they can enter the Finish Zone.
  • • Conclusion of Play: The match stays active until both players reach the Red FINISH cell. Once both have finished, the player with the lowest total dB accumulation is declared the winner.
    • Score
  • • On the You Interface: Noise Penalty (dB) tracks cumulative noise, Current Sensor shows the noise type for the active cell, Past Sound Moves logs visited cells, and the Status Bar shows active noise interference types impacting the map.
---
INIT
DISPLAY MODES
View
This project features two distinct modes tailored for different You experiences:
    VIEW Mode
  • • VIEW MODE (Accessibility Focus): Designed for data exploration. Users can click anywhere on the map grid to analyze acoustic data. The left column shows the identified location and detected sounds, while the right column provides an AI-generated summary of the area's acoustic environment.
    • GAME Mode
  • • GAME MODE: An interactive experience where users navigate the grid using pawns. It tracks accumulated noise penalty (dB), reveals the current sensor at your position, keeps a Past Sound Moves log, and uses the Status Bar to surface active noise interference on the map.
TEMPORAL NAVIGATION
Timeline View
Navigate the dataset's history using the interactive timeline and clock. To ensure a fun gameplay overview, data is by default filtered by monthly and without time specificity. On VIEW mode, data by default is filtered by date with time specifity.
Filter
  • • Timeline Slider: Groups acoustic data by date, week or month. The filter can be changed in the Menu > DATA FILTER.
  • • Time Clock: Cycle through specific times (Morning, Noon, etc.) within your selected period. If TIME SPECIFICITY is unchecked in the Menu, the clock is hidden and all data for the requested day/week/month is combined.
SOUND LEGENDS & INDICATORS
Each sound type is represented by a unique color-coded MTA bullet. When a sound is detected at a location, it is marked with a pulsing indicator in the corresponding color that can be referred back to the legends.
Sound Legends
● Alert Signal
● Dog
● Engine
● Human Voice
● Machinery Impact
● Music
● Non-Machinery Impact
● Powered Saw

The Sound Legend bar at the bottom allows you to toggle specifically which sounds you want to focus on. Toggling a legend item will update the timeline view to highlight periods where that specific sound is prominent.

DATASET CITATION
Cartwright, M., Cramer, J., Mendez, A.E.M., Wang, Y., Wu, H., Lostanlen, V., Fuentes, M., Dove, G., Mydlarz, C., Salamon, J., Nov, O., Bello, J.P. SONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Context. In Proceedings of the Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE), 2020.
VIEW ON ZENODO ↗
TEAM CREDIT
Elizabeth Kezia Widjaja, Shloka Mohanty, Matthew Blanco, Jisoo Kim, and Ian Askie.
TIMELINE TRACKER COLOR
CLICK ON CAMERA TO SAMPLE COLOR FOR ROLE
— or pick a color below —
H: 32

HSV - -

18
80
50
255
10
60
PLAYER 1
0.0 dB
P1
CURRENT SENSOR
waiting...
C
PAST SOUND MOVES
H
no history
LOCATION IDENTIFIED
Washington Sq Park
40.7308°N, 73.9973°W
L
SENSORS IN AREA
POINT OF INTEREST
GREENWICH VILLAGE GRID
PLAYER 2
0.0 dB
P2
CURRENT SENSOR
waiting...
C
PAST SOUND MOVES
H
no history
TEMPORAL CONTEXT
SELECT A DATE & TIME
AI
ACOUSTIC SUMMARY
Initializing SONYC-UST analysis engine...

Please select a specific cell on the grid to generate a localized acoustic summary for this date and time.