Development log

Code, tricks, quick technical ideas, recipes, progress reports, bash, ffmpeg and more…

ffmpeg: audio visualization tricks

September 2, 2017

Often one wants to share audio online, but it seems like video as a format has many more options: mastodon, twitter, facebook, youtube, all allow to upload video, but not only audio. Here are some ffmpeg tricks, how to add interesting video to your audio file, often autogenerated visuals. All the code is supposed to be used as one line without line-breaks.

Audio Vector Scope

ffmpeg -i INPUT_AUDIO.wav -filter_complex 
"[0:a]avectorscope=s=480x480:zoom=1.5:rc=0:gc=200:bc=0:rf=0:gf=40:bf=0,format=yuv420p[v]; 
 [v]pad=854:480:187:0[out]" 
 -map "[out]" -map 0:a 
-b:v 700k -b:a 360k 
OUTPUT_VIDEO.mp4

ffmpeg -i INPUT_AUDIO.wav -filter_complex

"[0:a]avectorscope=s=480x480:zoom=1.5:rc=0:gc=200:bc=0:rf=0:gf=40:bf=0,format=yuv420p[v];

[v]pad=854:480:187:0[out]"

-map "[out]" -map 0:a

-b:v 700k -b:a 360k

OUTPUT_VIDEO.mp4

The code above creates a mp4 video file with a vectorscope nicely centered inside a 854×480 (480p) video. If you need a 1:1 video, just exclude the pad part:

ffmpeg -i INPUT_AUDIO.wav -filter_complex 
"[0:a]avectorscope=s=480x480:zoom=1.5:rc=0:gc=200:bc=0:rf=0:gf=40:bf=0,format=yuv420p[v]" 
 -map "[v]" -map 0:a 
-b:v 700k -b:a 360k 
OUTPUT_VIDEO.mp4

ffmpeg -i INPUT_AUDIO.wav -filter_complex

"[0:a]avectorscope=s=480x480:zoom=1.5:rc=0:gc=200:bc=0:rf=0:gf=40:bf=0,format=yuv420p[v]"

-map "[v]" -map 0:a

-b:v 700k -b:a 360k

OUTPUT_VIDEO.mp4

Documentation on ‘avectorscope’ filter is here: https://ffmpeg.org/ffmpeg-filters.html#avectorscope. One can play with zoom and other options to produce desired form.

Show waves

ffmpeg -i INPUT.wav -filter_complex 
"[0:a]showwaves=mode=line:s=hd480:colors=White[v]" 
-map "[v]" -map 0:a -pix_fmt yuv420p 
-b:a 360k -r:a 44100  OUTPUT.mp4

ffmpeg -i INPUT.wav -filter_complex

"[0:a]showwaves=mode=line:s=hd480:colors=White[v]"

-map "[v]" -map 0:a -pix_fmt yuv420p

-b:a 360k -r:a 44100 OUTPUT.mp4

more options: http://www.ffmpeg.org/ffmpeg-filters.html#showwaves

Showspectrum

ffmpeg -i INPUT.wav  -filter_complex 
"[0:a]showspectrum=s=854x480:mode=combined:slide=scroll:saturation=0.2:scale=log,format=yuv420p[v]" 
 -map "[v]" -map 0:a 
 -b:v 700k -b:a 360k OUTPUT.mp4

ffmpeg -i INPUT.wav -filter_complex

"[0:a]showspectrum=s=854x480:mode=combined:slide=scroll:saturation=0.2:scale=log,format=yuv420p[v]"

-map "[v]" -map 0:a

-b:v 700k -b:a 360k OUTPUT.mp4

Above code will create almost completely desaturated spectrum of the audio sliding from right to left. Again, there are various options to tweak, see here: https://ffmpeg.org/ffmpeg-filters.html#showspectrum-1

Histogram

ffmpeg -i INPUT.wav -filter_complex 
"[0:a]ahistogram=s=hd480:slide=scroll:scale=log,format=yuv420p[v]" 
 -map "[v]" -map 0:a 
 -b:a 360k OUTPUT.mp4

ffmpeg -i INPUT.wav -filter_complex

"[0:a]ahistogram=s=hd480:slide=scroll:scale=log,format=yuv420p[v]"

-map "[v]" -map 0:a

-b:a 360k OUTPUT.mp4

Documentation: https://ffmpeg.org/ffmpeg-filters.html#ahistogram

Static spectrogram

Sometimes you want to just create a static image.

# create a spectrogram as a single frame
ffmpeg -i INPUT.wav -lavfi 
showspectrumpic=s=hd480:legend=0,format=yuv420p 
SPECTROGRAM.png

# add png to audio - you need to know the length of audio
ffmpeg -loop 1 -i SPECTROGRAM.png -i INPUT.wav 
-s hd480 -t 00:01:00 -pix_fmt yuv420p 
-b:a 360k -r:a 44100 OUTPUT.mp4

# create a spectrogram as a single frame

ffmpeg -i INPUT.wav -lavfi

showspectrumpic=s=hd480:legend=0,format=yuv420p

SPECTROGRAM.png

# add png to audio - you need to know the length of audio

ffmpeg -loop 1 -i SPECTROGRAM.png -i INPUT.wav

-s hd480 -t 00:01:00 -pix_fmt yuv420p

-b:a 360k -r:a 44100 OUTPUT.mp4

Above one is in two steps. More info here: http://www.ffmpeg.org/ffmpeg-filters.html#showspectrumpic

Drawtext

ffmpeg -i INPUT.wav -filter_complex 
"[0:a]showwaves=mode=line:s=hd480:colors=Yellow@0.5|Blue@0.5:scale=sqrt[v];
 [v]drawtext=text='Rudi Rudi - Still Standing':fontcolor=White@0.5:
 fontsize=30:font=Arvo:x=(w-text_w)/5:y=(h-text_h)/5[out]" 
 -map "[out]" -map 0:a -pix_fmt yuv420p 
 -b:a 360k -r:a 44100  OUTPUT.mp4

ffmpeg -i INPUT.wav -filter_complex

"[0:a]showwaves=mode=line:s=hd480:colors=Yellow@0.5|Blue@0.5:scale=sqrt[v];

[v]drawtext=text='Rudi Rudi - Still Standing':fontcolor=White@0.5:

fontsize=30:font=Arvo:x=(w-text_w)/5:y=(h-text_h)/5[out]"

-map "[out]" -map 0:a -pix_fmt yuv420p

-b:a 360k -r:a 44100 OUTPUT.mp4

Add text to any of the above with a “drawtext” filter. More options here: http://www.ffmpeg.org/ffmpeg-filters.html#drawtext-1

MikroTik RouterOS configuration for simple switch

May 20, 2017

My home network consist of:

little linux box acting as Media Server (to play videos off it and projector connected to it) and main routing and firewalling machine. it gets/sets an IP with our ISP and runs a DHCP server and DNS and IP masquerading and NAT-ing for the whole home LAN. The box itself has only one network port but I extended it with another USB network adapter – so, this box is connected to ADSL modem on one interface, and to another router (acting as a switch) on the other interface:
two SOHO consumer-level routers configured as simple switches/wireless bridges/AP with disabled DHCP and any routing – they just forward any connecting devices to DHCP on the main linux box.

I ordered a very cheap but seemingly powerful router by MikroTik “hAP lite RB941-2ND-TC” and configured it in the same way as other two routers – one of them of not both will need to be replaced by this new one. So, the configuration is as follows in the web interface – Quick Set:

set wireless Network Name if you want the way you want
under Internet set:
- Address Acquisition to “Static”
- IP address to 192.168.88.1
- Netmask (leave at) 255.0.0.0 (/8)
- Gateway to 192.168.88.1
- untick Firewall Router
under Local Network:
- IP Address: 192.168.88.1
- Netmask: 255.255.255.0 (/24)
- untick DHCP Server
- untick NAT
- leave UPnP unticked
VPN address should stay unticked
setup your new admin password, if you haven’t already, and Apply Configuration/Changes.

Now connect the (real) router – linux box to this MikroTik on non-internet port, either ports 1,2,3. You should now be able to connect via MikroTik either with a utp cable (again, not via port marked as internet) or wirelessly.

To go back to configuring your MikroTik, you need to connect to it with a cable and manually set your IP to something like 192.168.88.246 (disable your wifi etc..). Then you should be able to ping MikroTik or open the web interface at 192.168.88.1. Otherwise the MikroTik is somewhat invisible (apart from providing the AP – wifi access point name).

Tearing of fast action on NVIDIA

January 5, 2017

So with a brand new setup that includes a GLX/Geforce 1070 graphic card (will I ever be able to abuse all that GPU power?) I was somehow dissapointed to find non-uniform flickering, in other words the fast movement of things on screen was tearing. I didn’t prioritize this problem yet, but today I took time to look into it, and the following recipe solved it:

To avoid tearing, there’s a “workaround” – there are two options that seemingly need to be enabled in Xorg/nvidia driver: TripleBuffering and ForceCompositionPipeline (or ForceFullCompositionPipeline). My /etc/X11/xorg.com now contains the following in the “Screen” section:

Option    "TripleBuffer" "1"
Option    "metamodes" "HDMI-0: 1920x1080_60 +0+0 { ForceCompositionPipeline = On }, DVI-D-0: 1920x1080_60 +1920+0 { ForceCompositionPipeline = On }"

1 2	Option "TripleBuffer" "1" Option "metamodes" "HDMI-0: 1920x1080_60 +0+0 { ForceCompositionPipeline = On }, DVI-D-0: 1920x1080_60 +1920+0 { ForceCompositionPipeline = On }"

To find out what is your screens layout, you can do

xrandr | grep " connect"

1	xrandr \| grep " connect"

Also, if you want to fix tearing temporarily without changing any configuration files, use this command with something like that:

nvidia-settings --assign CurrentMetaMode="DVI-I-1: 1920x1200 { ForceCompositionPipeline = On }"

1	nvidia-settings --assign CurrentMetaMode="DVI-I-1: 1920x1200 { ForceCompositionPipeline = On }"

Supposedly forcing composition pipeline is causing some degradation in quality/speed in games.

Sources:
https://devtalk.nvidia.com/default/topic/543305/linux/screen-video-tearing-gtx6xx-7xx-kepler-9xx-maxwell-in-almost-all-applications-including-desktop/1
http://http.download.nvidia.com/XFree86/Linux-x86/325.15/README/configtwinview.html
https://forums.freebsd.org/threads/52311/#post-312833
https://forums.freebsd.org/threads/52311/#post-325927
http://us.download.nvidia.com/XFree86/Linux-x86_64/319.32/README/xconfigoptions.html

Learning SuperCollider patterns: legato, sustain and using pairs

December 24, 2016

Yesterday I had problems understanding why does a SynthDef and it’s Synth instance complain when it’s envelope duration is shorter than duration \dur. The following code will produce FAILURE IN SERVER /n_set Node 1067 not found complaints in the post window.

// an example of undefined sustain resulting in FAILURE IN SERVER
( // define a simple synth
SynthDef(\bip, { |out=0, freq=440, gate=1, amp=0.3|
    var sig, env;
	env = Env.linen(0.01, 1, 0.1);
	sig = Pulse.ar(freq, 0.3) * EnvGen.kr(env, gate, doneAction:2);
    Out.ar(out, sig * amp);
}).add;
)
( // define a simple pattern
Pbind(
	\instrument, \bip,
	\degree, Pseq([0, 2, 3], inf),
	\dur, Pseq([1, 2], inf)
).play;
)

// an example of undefined sustain resulting in FAILURE IN SERVER

( // define a simple synth

SynthDef(\bip, { |out=0, freq=440, gate=1, amp=0.3|

var sig, env;

env = Env.linen(0.01, 1, 0.1);

sig = Pulse.ar(freq, 0.3) * EnvGen.kr(env, gate, doneAction:2);

Out.ar(out, sig * amp);

}).add;

)

( // define a simple pattern

Pbind(

\instrument, \bip,

\degree, Pseq([0, 2, 3], inf),

\dur, Pseq([1, 2], inf)

).play;

)

The sound will be generated fine, but the problem is that the doneAction and sustain value in Env.linen result in the Synth instance being freed before Pbind does it. So when Pbind does tries to free it, it’s already gone, it doesn’t exist anymore.

I asked nice SC people on SC FB group and the answer led me to understand that there’s a good use of\sustain parameter in Pbind, which deals with exactly that. So to properly control sustain time, an example shows how it can be done:

(
SynthDef(\beeps, {
	arg amp = 0.8, gate = 1, sustain = 1, release = 0.3, freq = 440;
	var sig, env;

	env = Env.linen(attackTime:0.01, sustainTime: sustain, releaseTime: release);
	sig = Pulse.ar([freq,freq*0.001], 0.5) * amp * EnvGen.kr(env, gate, doneAction:2);

	Out.ar(0, sig * amp);
}).add
)

(
Pdef(\beepsin,
	Pbind(
		\instrument, \beeps,
		[\degree, \dur], Pseq([[0, 0.5], [2, 0.1], [3, 0.1], [2, 0.1], [5, 1], [Rest, Rest]], inf),
		//\sustain, 0.1,
		//\legato, 0.05,
		\release, 0.1,
		\amp, 0.1
	));
)

Pdef(\beepsin).play;

(

SynthDef(\beeps, {

arg amp = 0.8, gate = 1, sustain = 1, release = 0.3, freq = 440;

var sig, env;

env = Env.linen(attackTime:0.01, sustainTime: sustain, releaseTime: release);

sig = Pulse.ar([freq,freq*0.001], 0.5) * amp * EnvGen.kr(env, gate, doneAction:2);

Out.ar(0, sig * amp);

}).add

)

(

Pdef(\beepsin,

Pbind(

\instrument, \beeps,

[\degree, \dur], Pseq([[0, 0.5], [2, 0.1], [3, 0.1], [2, 0.1], [5, 1], [Rest, Rest]], inf),

//\sustain, 0.1,

//\legato, 0.05,

\release, 0.1,

\amp, 0.1

));

)

Pdef(\beepsin).play;

It seems like the most important part is that the SynthDef has a sustain argument. Pbind will calculate sustain from \dur so that it doesn’t even have to be defined in the Pbind.

There’s a nice thing used above, which I was looking for a while – how to defined note and it’s duration in pairs instead of on separate lines for each parameter: [\degree, \dur] and what follows is a list of pairs.

linux: auto-login

December 14, 2016

There’s couple of ways how to setup auto-login on linux. This one is geeky and not very user-friendly, but might come handy to somebody. This is on Ubuntu Linux 14.04.1/trusty with graphical login/desktop manager (lightdm) disabled.

install mingetty

 $ sudo apt-get install mingetty

1	$ sudo apt-get install mingetty

edit /etc/init/tty1.conf so that it looks like this:

# tty1 - getty
#
# This service maintains a getty on tty1 from the point the system is
# started until it is shut down again.

start on stopped rc RUNLEVEL=[2345] and (
            not-container or
            container CONTAINER=lxc or
            container CONTAINER=lxc-libvirt)

stop on runlevel [!2345]

respawn
#exec /sbin/getty -8 38400 tty1
exec /sbin/mingetty --autologin <YOUR USERNAME HERE> tty1

# tty1 - getty

# This service maintains a getty on tty1 from the point the system is

# started until it is shut down again.

start on stopped rc RUNLEVEL=[2345] and (

not-container or

container CONTAINER=lxc or

container CONTAINER=lxc-libvirt)

stop on runlevel [!2345]

respawn

#exec /sbin/getty -8 38400 tty1

exec /sbin/mingetty --autologin <YOUR USERNAME HERE> tty1

The most important part are the last three lines. Change username to what you have.

Edit your ~/.profile and add at the bottom:

if [ -z "$DISPLAY" ] && [ -n "$XDG_VTNR" ] && [ "$XDG_VTNR" -eq 1 ]; then
	startx
fi

if [ -z "$DISPLAY" ] && [ -n "$XDG_VTNR" ] && [ "$XDG_VTNR" -eq 1 ]; then

startx

Reboot and you should end up in your X session.

Sources:
askubuntu.com/quest…unning-upstart
https://wiki.archlinux.org/index.php/Xinit

supercollider: easy beats with patterns

December 13, 2016

///////////////// some easy beats, yo!
(

// somekind of highhat - enveloped whitenoise
SynthDef(\highhat, { | amp,freq,release |
	var env, sig;

	env = Env.perc(0.001,release);
	sig = WhiteNoise.ar(EnvGen.kr(env, doneAction: 2));
	sig = HPF.ar(sig, freq:freq);
	sig = Splay.ar(sig);
	sig = sig * amp;

	Out.ar(0,sig);
}).add;


// bass kick
SynthDef(\kicker, {
	var sig, env;

	env = Env.perc(0.01, 2, 1);
	sig = LFPar.ar(
		freq:50,
		mul: EnvGen.kr(env, doneAction: 2)
	) * 10;
	sig = Splay.ar(sig.distort * 0.5);

	Out.ar(0, sig);
 }).add;


~oscBridge = NetAddr.new("127.0.0.1", 12000);


h = Pbind(
	\dur, Pseq([ 4, 4, 4, 4, 2, 2, 4, 4, 2, 1, 1 ], inf),
	\instrument, \highhat,
	\amp, Pseq([ 1, 0.9, 1, 0.5, 1, 0.9, 0.2, 0.9,     1, 0.6, 1          ], inf),
	\freq, Pseq([9000,8000,7000,1000], inf),
	\release, Pseq([0.07, 0.09, 0.06, 0.2, 1], inf),
).play(quant:32);

k = Pbind(
	\instrument, \kicker,
	\dur, 32
).play(quant:32);

TempoClock.default.tempo = 100/6;


) ////////////////////////////////////////////////////////////////////////////

///////////////// some easy beats, yo!

(

// somekind of highhat - enveloped whitenoise

SynthDef(\highhat, { | amp,freq,release |

var env, sig;

env = Env.perc(0.001,release);

sig = WhiteNoise.ar(EnvGen.kr(env, doneAction: 2));

sig = HPF.ar(sig, freq:freq);

sig = Splay.ar(sig);

sig = sig * amp;

Out.ar(0,sig);

}).add;

// bass kick

SynthDef(\kicker, {

var sig, env;

env = Env.perc(0.01, 2, 1);

sig = LFPar.ar(

freq:50,

mul: EnvGen.kr(env, doneAction: 2)

) * 10;

sig = Splay.ar(sig.distort * 0.5);

Out.ar(0, sig);

}).add;

~oscBridge = NetAddr.new("127.0.0.1", 12000);

h = Pbind(

\dur, Pseq([ 4, 4, 4, 4, 2, 2, 4, 4, 2, 1, 1 ], inf),

\instrument, \highhat,

\amp, Pseq([ 1, 0.9, 1, 0.5, 1, 0.9, 0.2, 0.9, 1, 0.6, 1 ], inf),

\freq, Pseq([9000,8000,7000,1000], inf),

\release, Pseq([0.07, 0.09, 0.06, 0.2, 1], inf),

).play(quant:32);

k = Pbind(

\instrument, \kicker,

\dur, 32

).play(quant:32);

TempoClock.default.tempo = 100/6;

) ////////////////////////////////////////////////////////////////////////////

minor random bliss in two

December 12, 2016

Learning Patterns in SuperCollider, here’s a little lullaby:

(

SynthDef(\param, { arg freq = 100, sustain, amp;
	var sig;
    sig = LFPar.ar(freq: freq,
        mul: EnvGen.kr(Env.perc(0, sustain, 0.5), doneAction:2) * amp);
	sig = Splay.ar(sig);
	Out.ar(0, sig);
}).add;

e = Pbind(
	\midinote, Prout({
		var tone0, tone1, tone2, interval, freq0, delta;
		loop {
			tone0 = rrand(0,11);
			interval = rrand(2,4);
			tone1 = Scale.minor(\pythagorean).at(tone0) + [0,12,24].choose + 0.07;
			tone2 = Scale.minor(\pythagorean).at(tone0 + interval) + [0,12,24].choose;
			freq0 = [tone1,tone2]+48;
			postln(freq0);
			freq0.yield;
		}
	}),
    \dur, Prand([1,2,4,8,12,16,4,6,8], inf),
    \instrument, \param,
	\amp, 0.5,
	\sustain, 1,
).play(quant:1); // returns an EventStream
TempoClock.default.tempo = 200/60;

)

(

SynthDef(\param, { arg freq = 100, sustain, amp;

var sig;

sig = LFPar.ar(freq: freq,

mul: EnvGen.kr(Env.perc(0, sustain, 0.5), doneAction:2) * amp);

sig = Splay.ar(sig);

Out.ar(0, sig);

}).add;

e = Pbind(

\midinote, Prout({

var tone0, tone1, tone2, interval, freq0, delta;

loop {

tone0 = rrand(0,11);

interval = rrand(2,4);

tone1 = Scale.minor(\pythagorean).at(tone0) + [0,12,24].choose + 0.07;

tone2 = Scale.minor(\pythagorean).at(tone0 + interval) + [0,12,24].choose;

freq0 = [tone1,tone2]+48;

postln(freq0);

freq0.yield;

}

}),

\dur, Prand([1,2,4,8,12,16,4,6,8], inf),

\instrument, \param,

\amp, 0.5,

\sustain, 1,

).play(quant:1); // returns an EventStream

TempoClock.default.tempo = 200/60;

)

SuperCollider Help in dark grey

December 10, 2016

In order to browse and use SuperCollider help system in inverted gray colours, there are two quick hacks:

modify internal Help system
style the help on doc.sccode.org using Stylish

To modify internal Help system find the file /usr/local/share/SuperCollider/HelpSource/scdoc.css and add at the bottom/end of the file:

body {
    background: #333;
    color: #333;
    -webkit-filter: invert(100%);
    filter: invert(100%) ;
}

body {

background: #333;

color: #333;

-webkit-filter: invert(100%);

filter: invert(100%) ;

}

If you use doc.sccode.org and a Stylish add-on in (for example) Firefox to custom-style pages, you can add a new style which is similar to the above:

@namespace url(http://www.w3.org/1999/xhtml);

@-moz-document domain("doc.sccode.org") {
  body {
    background: #333;
    color: #333;
    -webkit-filter: invert(100%) !important;
    filter: invert(100%) !important;
  }
}

@namespace url(http://www.w3.org/1999/xhtml);

@-moz-document domain("doc.sccode.org") {

body {

background: #333;

color: #333;

-webkit-filter: invert(100%) !important;

filter: invert(100%) !important;

}

Processing and Awesome WM

November 25, 2016

Processing is a Java application and has had troubles in my Awesome setup for a while now in various ways. With some early versions (2.x) the main IDE window didn’t want to redraw following a resize. Now with new IDE in 3.x series this problem is gone, but now the main output window thinks it has a window decoration and is offset in a very ugly way, showing a wide grey bar at the bottom and slighly less wide one on the right (lack of top window decoration and a scrollbar probably.

These problems can be solved with a program called wmname before starting a java application.

$ wmname LG3D

1	$ wmname LG3D

(source: https://awesomewm.org/wiki/Problems_with_Java)
You can find it in the ‘suckless-tools’ package on Ubuntu/Debian.

It seems this needs to be run only once in one of the terminals and it then works accross any subsequent commands in the current session. Probably not stupid to put it in ~/.config/awesome/rc.lua?

making of Requiem for The Future: A.I. video

November 1, 2016

The biggest part of creating this video was to generate satisfactory glitched material. I researched various ways how to glitch images using SoX tool and a glitch in pre-3.0 ffmpeg’s jpeg-le codec. Below is a BASH script which worked through all .mov videos in the current folder, extracted frames, glitched it and stitched back the videos from frames. Here’s the gist of all glitches in a summary:

# pre-3.0 ffmpeg jpeg-le glitch
ffmpeg -i INPUT.ppm -c:v jpegls -pred 60 OUTPUT.jpg

# all sox operations used a .ppm file format
# interpreted as:
RAWFILEOPTS="-e unsigned -r 44100 -b 8 -c 2"
# which was then used like this:
sox -t raw $RAWFILEOPTS INPUT.ppm -t raw $RAWFILEOPTS OUTPUT.ppm $EFFECT

# and effects EFFECT used were:

# echoes
echos 0.2 0.2 6700 0.5 4900 0.5 9200 0.5 1400 0.5

# reversed echoes
reverse echos 0.2 0.2 6700 0.5 4900 0.5 9200 0.5 1400 0.5

# earwax
earwax

# stretch
stretch 1.00002

# chorus
chorus 0.5 1 90 0.4 0.25 9 -t 60 0.32 0.4 0.2 -t 40 0.3 0.3 0.5 -s

# downsample (use 50 or 99)
downsample 50

# reverb 1
gain -15 reverb 75 0 100 100 0 10

# reverb 2
reverb -w 50 50 5 100 0 0

# trim
repeat 3 \
trim $((RANDOM%3+1))  $((RANDOM%3+6))  $((RANDOM%3+8))  $((RANDOM%3+14))  $((RANDOM%3+19))\
trim $((RANDOM%3+1))  $((RANDOM%3+6))  $((RANDOM%3+8))  $((RANDOM%3+11))  $((RANDOM%3+14))\
trim $((RANDOM%3+1))  $((RANDOM%3+6))  $((RANDOM%3+8))  $((RANDOM%3+14))  $((RANDOM%3+19))

# pre-3.0 ffmpeg jpeg-le glitch

ffmpeg -i INPUT.ppm -c:v jpegls -pred 60 OUTPUT.jpg

# all sox operations used a .ppm file format

# interpreted as:

RAWFILEOPTS="-e unsigned -r 44100 -b 8 -c 2"

# which was then used like this:

sox -t raw $RAWFILEOPTS INPUT.ppm -t raw $RAWFILEOPTS OUTPUT.ppm $EFFECT

# and effects EFFECT used were:

# echoes

echos 0.2 0.2 6700 0.5 4900 0.5 9200 0.5 1400 0.5

# reversed echoes

reverse echos 0.2 0.2 6700 0.5 4900 0.5 9200 0.5 1400 0.5

# earwax

earwax

# stretch

stretch 1.00002

# chorus

chorus 0.5 1 90 0.4 0.25 9 -t 60 0.32 0.4 0.2 -t 40 0.3 0.3 0.5 -s

# downsample (use 50 or 99)

downsample 50

# reverb 1

gain -15 reverb 75 0 100 100 0 10

# reverb 2

reverb -w 50 50 5 100 0 0

# trim

repeat 3 \

trim $((RANDOM%3+1)) $((RANDOM%3+6)) $((RANDOM%3+8)) $((RANDOM%3+14)) $((RANDOM%3+19))\

trim $((RANDOM%3+1)) $((RANDOM%3+6)) $((RANDOM%3+8)) $((RANDOM%3+11)) $((RANDOM%3+14))\

trim $((RANDOM%3+1)) $((RANDOM%3+6)) $((RANDOM%3+8)) $((RANDOM%3+14)) $((RANDOM%3+19))

Here’s a full bash script:

Continue reading →

jpeg-LS glitching with FFmpeg

October 26, 2016

In an older version of FFmpeg it was possible to glitch the image with JPEG-LS codec. Newer versions of FFmpeg don’t work anymore in this way, so one must download an old version and compile it (keep it local) – here 2.0.7 is used.

This script takes a video file as an argument, extracts frames, glitches them, and gathers frames back into a video file.

#!/bin/bash

# jpeg-LS glitcher by nova@deviator.si http://deviator.si

# check existence of input argument
# the $# variable will tell you the
# number of input arguments the script was passed. 
if [ $# -eq 0 ]
  then
    echo "Error. No arguments supplied. Please define a video"
    exit 1
fi

# does the movie file actually exist?
if [ ! -f $1 ]; then
    echo "Error. File not found!"
    exit 1
fi

# get this session's "ID"
SID=`date +%Y%m%d_%H%M%S`

# jpegls glitch needs an older ffmpeg 
FFMPEG=/home/random/src/ffmpeg/ffmpeg-2.0.7/ffmpeg

# create folder for this session
DIR=jpegls_$SID
echo "+++ creating folder $DIR ..."
mkdir $DIR

# create tmp folder
echo "+++ creating folder $DIR/tmp/ ..."
mkdir $DIR/tmp/

echo "+++ extracting all frames as images..."
echo
echo "----------------------------------------------------------"
echo
ffmpeg -loglevel 16 -i $1 $DIR/tmp/frame%5d.jpg

echo 
echo "----------------------------------------------------------"
echo "+++ processing each image..."

for i in $DIR/tmp/*.jpg
do
    
    echo "processing $i "
    $FFMPEG -loglevel 16 -i $i -pred 80 -c:v jpegls $i.jpgls.jpg
    ffmpeg -loglevel 16 -i $i.jpgls.jpg -c:v png $i.png
    
done

echo
echo "----------------------------------------------------------"
echo "+++ putting frames back into a movie ... "
ffmpeg -loglevel 16 -i $DIR/tmp/frame%5d.jpg.png $DIR/$SID.$1

echo
echo "+++ removing temporary folder ..."
rm -rf $DIR/tmp/

echo "\n--- end of the program. "

#!/bin/bash

# jpeg-LS glitcher by nova@deviator.si http://deviator.si

# check existence of input argument

# the $# variable will tell you the

# number of input arguments the script was passed.

if [ $# -eq 0 ]

then

echo "Error. No arguments supplied. Please define a video"

exit 1

# does the movie file actually exist?

if [ ! -f $1 ]; then

echo "Error. File not found!"

exit 1

# get this session's "ID"

SID=`date +%Y%m%d_%H%M%S`

# jpegls glitch needs an older ffmpeg

FFMPEG=/home/random/src/ffmpeg/ffmpeg-2.0.7/ffmpeg

# create folder for this session

DIR=jpegls_$SID

echo "+++ creating folder $DIR ..."

mkdir $DIR

# create tmp folder

echo "+++ creating folder $DIR/tmp/ ..."

mkdir $DIR/tmp/

echo "+++ extracting all frames as images..."

echo

echo "----------------------------------------------------------"

echo

ffmpeg -loglevel 16 -i $1 $DIR/tmp/frame%5d.jpg

echo

echo "----------------------------------------------------------"

echo "+++ processing each image..."

for i in $DIR/tmp/*.jpg

echo "processing $i "

$FFMPEG -loglevel 16 -i $i -pred 80 -c:v jpegls $i.jpgls.jpg

ffmpeg -loglevel 16 -i $i.jpgls.jpg -c:v png $i.png

done

echo

echo "----------------------------------------------------------"

echo "+++ putting frames back into a movie ... "

ffmpeg -loglevel 16 -i $DIR/tmp/frame%5d.jpg.png $DIR/$SID.$1

echo

echo "+++ removing temporary folder ..."

rm -rf $DIR/tmp/

echo "\n--- end of the program. "

glitching images & movies with audio effect using sox

October 26, 2016

Some tutorial will be here soon, but for now, this script that glitches your video file.

Requires bash, ffmpeg & sox.

#!/bin/bash

# SOCKS0FF glitcher
# ffmpeg->imagemagick->sox->ffmpeg

# by nova@deviator.si | http://deviator.si

# -----------------------------------------------------------------------

# some settings. change these to get different results.


# which image type you want to use for glitching?
# very good one is a simple PPM. can also be tiff.
IMGEXT="ppm"

# raw file interpretation by sox
RAWFILEOPTS="-e unsigned -r 44100 -b 8 -c 2"

# sox effect
#SOXEFFECT="echo 1 0.9 700 0.9" 
SOXEFFECT="pitch 4.5"
#SOXEFFECT="phaser 1 0.15 0.1 0.9 0.6"
#SOXEFFECT="chorus 0.5 0.9 50 0.4 0.25 2 -t 60 0.32 0.4 2.3 -t 40 0.3 0.3 1.3 -s"
#SOXEFFECT="chorus 0.9 1 50 0.4 0.25 0.1 -t 60 0.32 0.4 0.2 -t 40 0.3 0.3 0.5 -s"
#SOXEFFECT="earwax"
#SOXEFFECT="flanger 30 10 -9 100 0.1 sin 50 lin gain 3"
#SOXEFFECT="overdrive 20 10"
#SOXEFFECT="stretch 2"
#SOXEFFECT="stretch 1.004"
#SOXEFFECT="stretch 1.02"
#SOXEFFECT="tempo -l 0.7 120 30"
#SOXEFFECT=""

# image header size in bytes - it will be preserved in new file
HEADERSIZE=400


echo "---[ STARTING SOXOFF! ]----------------------------------"

# check existence of input argument
# the $# variable will tell you the
# number of input arguments the script was passed. 
if [ $# -eq 0 ]
  then
    echo "Error. No arguments supplied."
    exit 1
fi


# get this session's "ID"
SID=`date +%Y%m%d_%H%M%S`

# create folder for this session
DIR=soxoffd_$SID
echo "+++ creating folder $DIR ..."
mkdir $DIR

# create tmp folder
echo "+++ creating folder $DIR/tmp/ ..."
mkdir $DIR/tmp/

echo "+++ extracting all frames as images..."
echo
echo "----------------------------------------------------------"
echo
ffmpeg -i $1 $DIR/tmp/frame%5d.$IMGEXT


echo 
echo "----------------------------------------------------------"
echo "+++ processing each image..."

for i in $DIR/tmp/*.$IMGEXT
do
    echo "---[ $i "

    # fetch original file size
    FILESIZE=`stat -c%s $i`

    echo "+++ soxing with $SOXEFFECT ... "
    sox -t raw $RAWFILEOPTS $i -t raw $RAWFILEOPTS $i.soxed $SOXEFFECT

    echo "+++ fixing headers..."
    head -c $HEADERSIZE $i > $i.header
    head -c $FILESIZE $i.soxed > $i.trimmed
    tail -c `expr $FILESIZE - $HEADERSIZE` $i.trimmed >> $i.header
    mv $i.header $i
    rm $i.soxed $i.trimmed


    echo
done

echo
echo "----------------------------------------------------------"
echo "+++ putting frames back into a movie ... "
ffmpeg -i $DIR/tmp/frame%5d.$IMGEXT $DIR/$SID_$1

echo
echo "+++ removing temporary folder ..."
rm -rf $DIR/tmp/

echo
echo "---[ end of the program. ]---"

100

101

102

103

104

105

#!/bin/bash

# SOCKS0FF glitcher

# ffmpeg->imagemagick->sox->ffmpeg

# by nova@deviator.si | http://deviator.si

# -----------------------------------------------------------------------

# some settings. change these to get different results.

# which image type you want to use for glitching?

# very good one is a simple PPM. can also be tiff.

IMGEXT="ppm"

# raw file interpretation by sox

RAWFILEOPTS="-e unsigned -r 44100 -b 8 -c 2"

# sox effect

#SOXEFFECT="echo 1 0.9 700 0.9"

SOXEFFECT="pitch 4.5"

#SOXEFFECT="phaser 1 0.15 0.1 0.9 0.6"

#SOXEFFECT="chorus 0.5 0.9 50 0.4 0.25 2 -t 60 0.32 0.4 2.3 -t 40 0.3 0.3 1.3 -s"

#SOXEFFECT="chorus 0.9 1 50 0.4 0.25 0.1 -t 60 0.32 0.4 0.2 -t 40 0.3 0.3 0.5 -s"

#SOXEFFECT="earwax"

#SOXEFFECT="flanger 30 10 -9 100 0.1 sin 50 lin gain 3"

#SOXEFFECT="overdrive 20 10"

#SOXEFFECT="stretch 2"

#SOXEFFECT="stretch 1.004"

#SOXEFFECT="stretch 1.02"

#SOXEFFECT="tempo -l 0.7 120 30"

#SOXEFFECT=""

# image header size in bytes - it will be preserved in new file

HEADERSIZE=400

echo "---[ STARTING SOXOFF! ]----------------------------------"

# check existence of input argument

# the $# variable will tell you the

# number of input arguments the script was passed.

if [ $# -eq 0 ]

then

echo "Error. No arguments supplied."

exit 1

# get this session's "ID"

SID=`date +%Y%m%d_%H%M%S`

# create folder for this session

DIR=soxoffd_$SID

echo "+++ creating folder $DIR ..."

mkdir $DIR

# create tmp folder

echo "+++ creating folder $DIR/tmp/ ..."

mkdir $DIR/tmp/

echo "+++ extracting all frames as images..."

echo

echo "----------------------------------------------------------"

echo

ffmpeg -i $1 $DIR/tmp/frame%5d.$IMGEXT

echo

echo "----------------------------------------------------------"

echo "+++ processing each image..."

for i in $DIR/tmp/*.$IMGEXT

echo "---[ $i "

# fetch original file size

FILESIZE=`stat -c%s $i`

echo "+++ soxing with $SOXEFFECT ... "

sox -t raw $RAWFILEOPTS $i -t raw $RAWFILEOPTS $i.soxed $SOXEFFECT

echo "+++ fixing headers..."

head -c $HEADERSIZE $i > $i.header

head -c $FILESIZE $i.soxed > $i.trimmed

tail -c `expr $FILESIZE - $HEADERSIZE` $i.trimmed >> $i.header

mv $i.header $i

rm $i.soxed $i.trimmed

echo

done

echo

echo "----------------------------------------------------------"

echo "+++ putting frames back into a movie ... "

ffmpeg -i $DIR/tmp/frame%5d.$IMGEXT $DIR/$SID_$1

echo

echo "+++ removing temporary folder ..."

rm -rf $DIR/tmp/

echo

echo "---[ end of the program. ]---"

sound, noise, music & new media

Development log

ffmpeg: audio visualization tricks

Audio Vector Scope

Show waves

Showspectrum

Histogram

Static spectrogram

Drawtext

MikroTik RouterOS configuration for simple switch

Tearing of fast action on NVIDIA

Learning SuperCollider patterns: legato, sustain and using pairs

linux: auto-login

supercollider: easy beats with patterns

minor random bliss in two

SuperCollider Help in dark grey

Processing and Awesome WM

making of Requiem for The Future: A.I. video

jpeg-LS glitching with FFmpeg

glitching images & movies with audio effect using sox

About

Newsletter

Events