Is there an easy way to get amplitude/peaks of a sound file to draw its waveform shape?

Comments

• keszegh Member

  May 2023

  if i could do this for live input (microphone) to recognize the 'beats' that would be especially useful to me, so far in my animation app if i want to sync if with prerecorded or live music then i need to use a separate app (mixxx for prerecorded and a custom pd patch for live).

  Longtitle Productions, creator of
  Fragmenter - animated loop machine and IKONOMIKON - the memory game

  +1 -1Share on Facebook
• pie Member

  May 2023

  For live input isn't microphone event listener enough?
  I guess if peakamplitude > than mean_peak it could be a beat

  microphone:addEventListener(Event.DATA_AVAILABLE, function(event) print("*") levelMeter:setLevel(event.peakAmplitude) end)

  +1 -1Share on Facebook
• keszegh Member

  May 2023

  what is this levelMeter:setLevel(event.peakAmplitude) thing?
  
  you mean using this data?:
  https://wiki.gideros.rocks/index.php/Event.DATA_AVAILABLE
  
  sounds promising indeed.

  Longtitle Productions, creator of
  Fragmenter - animated loop machine and IKONOMIKON - the memory game

  +1 -1Share on Facebook
• pie Member

  May 2023 edited May 2023

  @keszegh exactly
  levelMeter is just an indicator (https://github.com/gideros/Microphone/blob/master/example/main.lua)
  
  super easy to substitute with imgui progressBar

  +1 -1Share on Facebook
• keszegh Member

  May 2023 edited May 2023

  i see, this levelMeter is not documented in the wiki.
  
  also this cited example project does not seem to be offered in gideros at startup.

  Longtitle Productions, creator of
  Fragmenter - animated loop machine and IKONOMIKON - the memory game

  +1 -1Share on Facebook
• pie Member

  May 2023 edited May 2023

  keszegh said:

  i see, this levelMeter is not documented in the wiki.
  

  It's not documented because it's not part of the gideros libs: you can find it as a stand alone class in atilim's repository, but in the end it's just a progress bar

  Likes: keszegh

  +1 -1 (+1 / -0 )Share on Facebook
• PaulH Member

  May 2023

  On the question of finding the amplitude from a file, at least in a WAV file I believe the amplitude any any given moment would be the highest value of the sample data within a range that covers the wavelength of the lowest audible sound. That is, you could read the header, find the bits per sample and samples per second, then jump past the header and read the individual samples, and then find the highest value over a range of samples covering the length of time you're interested in, but say at least 1/20 of a second since sounds lower than 20Hz are probably not relevant. If it's a 16 bit WAV file, you'd read 2 bytes, convert it to a number and then compare that against the highest encountered so far, and repeat for (samples per second / 20) values. Then the relative amplitude is that highest value divided by the maximum 16 bit value.
  
  I haven't tried it, but I suspect that would work.
  

  Likes: pie

  +1 -1 (+1 / -0 )Share on Facebook
• rrraptor Member

  May 2023 Accepted Answer

  
  

  
  
  https://github.com/MultiPain/Gideros_examples/tree/master/WAVe visualizer

  Likes: keszegh, pie, MoKaLux, PaulH, hgy29

  SuperShape | Nice blured shapes with shadows | Simple button pad | Simple layer class | Simple UI library | 2D camera lib | Color picker | FPS graph | Dear ImGui | cute_c2

  +1 -1 (+5 / -0 )Share on Facebook
• keszegh Member

  May 2023

  @rrraptor , that's neat

  Likes: pie, MoKaLux

  Longtitle Productions, creator of
  Fragmenter - animated loop machine and IKONOMIKON - the memory game

  +1 -1 (+2 / -0 )Share on Facebook
• rrraptor Member

  May 2023

  rrraptor said:

  https://github.com/MultiPain/Gideros_examples/tree/master/WAVe visualizer

  Added support for 24 & 32 bits PCM, 64 bits FLOAT, a-law, mu-law.
  Fixed 32 bits FLOAT.
  Fixed "bar" visualization

  Likes: MoKaLux, pie

  SuperShape | Nice blured shapes with shadows | Simple button pad | Simple layer class | Simple UI library | 2D camera lib | Color picker | FPS graph | Dear ImGui | cute_c2

  +1 -1 (+2 / -0 )Share on Facebook
• keszegh Member

  May 2023

  @rrraptor can you add support for microphone input analyzing? (i did not check the project yet, so if it is already there, then all the better)

  Longtitle Productions, creator of
  Fragmenter - animated loop machine and IKONOMIKON - the memory game

  +1 -1Share on Facebook
• rrraptor Member

  May 2023

  @keszegh I know nothing about sounds
  Made simple recording app xD
  
  Recorded file:
  

  Likes: pie, keszegh, PaulH

  SuperShape | Nice blured shapes with shadows | Simple button pad | Simple layer class | Simple UI library | 2D camera lib | Color picker | FPS graph | Dear ImGui | cute_c2

  +1 -1 (+3 / -0 )Share on Facebook