Saturday, August 14, 2021

Suggestions for Using Spleeter

A couple of days ago, while working on the George Harrison album "All Things Must Pass - Acoustic," I stumbled across a truly great free sound editing program called Spleeter. I've been editing audio for a few years now, and I'd always understood that there were severe limits over what one could do. Basically, once all the different tracks (or channels, if you want to call them that) of a song were mixed together into stereo or mono, one couldn't undo them, just like one couldn't unbake a cake. Either one had to have access to the original multitracks, which was rare, or one had to go to great expense using fancy technology to separate the tracks out. The people in control of the Beatles' music did this to about 70 of their songs so they could be used for the video game Rock Band, but that was said to be very difficult and cost millions of dollars.

But hey, technology keeps improving! It turns out Spleeter first appeared in late 2019, and has been getting better since, so this is fairly new stuff. Here's how the program works: you drag and drop a song file into a certain area of the program page, then it splits it into as many as five different tracks. If you choose the five track option, you get tracks for 1) vocals, 2) bass, 3) drums, 4) piano, and 5) other. The program has its limitations - I'm especially frustrated that guitars aren't their own separate track, and get lumped in with whatever other instruments happened to be there that don't fit the first four categories. Plus, sometimes there's some sound quality loss and/or things sound a bit off. But still, compared to the crude methods available before, this program seems to be a game changer!

So here's what this post is about. I think I'll be able to do lots of interesting things with this program that I can post on this blog, but I've just begun to think about the possibilities. I'd like to hear if you have any suggestions on music that can be improved using this technology. Here are some options.

1) Sometimes songs or even whole albums are mixed badly. Consider "Watch That Man" by David Bowie. The vocals are mixed inexplicably low. I just used Spleeter to boost the vocals but keep everything else the same, and it sounds much better, in my opinion. So I'd like to hear of other songs that are in need of obvious fixing. Perhaps even other people can try using Spleeter and post their changes here. But again, be mindful of the program's limitations. For instance, you can't separate out the lead vocals from the backing vocals (unless they don't overlap).

2) For the George Harrison album "All Things Must Pass - Acoustic," I was able to take some demos with loud bass and drums on them and strip them down to just the vocals and guitar. I think it worked quite well. (Check out my posting of the album from a couple of days ago to judge for yourself.) It's possible other songs or even entire albums could be edited to create acoustic versions. In some cases, I don't think it would work that well. For instance, I was thinking it would be interesting to cut down the production of ELO (Electric Light Orchestra) albums, but the guitars and orchestra are lumped together on that "other" track. However, in other cases it might work very well. The fact that there's a separate track just for piano (by the way, it seems to only be piano and not keyboards or synths), could make it possible to create solo acoustic versions of some Elton John albums, I'd think.

3) A commenter at this blog already noted that the program could be used to improve interesting bootlegs that unfortunately are mixed badly. For instance, imagine a bootleg that sounds great, but the vocals are too low. Spleeter might or might not be able to fix that, depending on just how low the vocals are, but it could help in some cases. So I'd be interested to hear of bootlegs that might be improved.

4) A special category in my mind are 1980s albums that suffer from overproduction. In my opinion, many musicians who were big in the 1960s and 1970s went astray trying to keep up with the trending sounds of the 1980s. Typically, there was too much synth, and the drums were way too loud. I'm not sure how much Spleeter could help with the synths, since those are lumped in the "other" track, but it certainly could help with the drums. In fact, as an experiment, today I used Spleeter to completely remove the drums and bass from one of Joni Mitchell's 1980s albums, "Wild Things Run Fast." It sounds VERY different. It's an improvement, at least in my opinion, sounding much more like her beloved albums from the 1960s and early 1970s.

Those are just some ideas off the top of my head. Perhaps you could think of others? This program can be misused in ways that may upset the musicians involved. But I think it could be used in positive ways, if used wisely.

Here's one example. This zip file contains two versions of David Bowie's song "Watch That Man," from his 1973 album "Aladdin Sane." They're identical, except I boosted the vocals in the one with "Volume Edit" in the title. I didn't change it a lot, but enough so you can actually hear what he's saying most of the time.

https://www99.zippyshare.com/v/S0txCeYi/file.html

Here's another example that I've edited to make the differences more noticeable. This is of the song "Carouselamba" from the 1979 Led Zeppelin album "In through the Out Door." Supposedly, guitarist Jimmy Page thought that singer Robert Plant wrote lyrics to the song that were critical of him, so he mixed them way down. This zip has that version, plus the Spleeter volume adjusted version. I still can't tell what Plant is singing much of the time, but at least his voice stands out now.

https://www120.zippyshare.com/v/WVynMtpj/file.html

Anyway, suggestions on what to do - or not to do - with this program are welcome! (Also note that it seems Spleeter accepts most any music file, so a high quality .flac file will have better sound results than an .mp3.)

By the way, here's the version of Joni Mitchell's "Wild Things Must Fast" album without drums or bass, as mentioned above. This was a crude experiment just to see what one could do. Perhaps a more clever edit would be to reduce the drums and bass on a case by case basis rather than removing them completely. But this can give you an idea of Spleeter's capabilities.

https://www40.zippyshare.com/v/m7zoAUzM/file.html

34 comments:

  1. I looked at this it was too complicated for me to install...best of luck it seems to be great I would love to use on some bootlegs

    ReplyDelete
    Replies
    1. I found a GUI version of spleeter, that avoid all complexities in term of installation on Windows 10 (Python, pip, etc....) :
      SpleeterGUI - Music source separation desktop app
      https://makenweb.com/SpleeterGUI
      one minute to install and without any IT kowledge on anything.
      I tried Spleeter on several songs or tracks , and generally the result of the spleet is bad, even on for example Jerry Lee Lewis tracks where guitar, piano, vocals and dreams seem clearly separared in the mix. I think Spleeter is a good idea but should imply still several years of AI and software development before to produce acceptable results. Good idea however

      Delete
    2. Thanks for that link. That's the version I'm using already, but I forgot what the link was. It makes things really easy.

      I don't know about Spleeter being bad - I think it depends on what you do with it. Some things work well and some things don't, in my opinion. For instance, with the two examples I posted, I think "Watch That Man" sounds a lot better than "Carouselambra." It'll take some trial and error to figure out what works and what doesn't.

      Delete
    3. Thanks, I don't have the AVX i guess that's why it doesn't work for me?...if anyone could tackle The Monkees Pool it album to strip out that awful 80's production that would be amazing

      Delete
  2. Neil Young - Time Fades Away (horrendous mix!)
    Warren Zevon -Sentimental Hygiene ( those 80's drums)
    Pink Floyd '77 Animals Tour Bootlegs (just no great balance)
    Nick Drake Albums - Stripped back from the orchestration. (That would be really nice indeed, if this works I think lots of people would be really happy!)

    ReplyDelete
    Replies
    1. Neil Young - Comes A Time. Maybe the overdubs can be removed to give the original solo album? Sounds impossible to me!

      Delete
    2. You can't really strip back the orchestration on anything, because that goes in the same "other" track as the guitar. However, with Nick Drake I've already posted some orchestra-free versions at this blog using a different method. So check that out.

      Re: "Come a Time," again, the overdubbed parts are going to be on the same track as the guitar. But I hear that NY is going to post the acoustic version with his Archives 3 project.

      Delete
  3. https://melody.ml/

    You can use this website to test ideas. I just tried Neil Young's track Hippie Dream from Landing On Water. It's very interesting tech indeed! I'm really quite amazed!

    ReplyDelete
  4. I always thought that a version of The Beatles Esher demos would be great with one of the two vocals tracks each song seems to have removed. This would make it more listenable IMHO. Not sure this is possible with this program however.

    ReplyDelete
    Replies
    1. Unfortunately, that's not possible. There's just one track for each major things, such as vocals. So you can't pull out only part of the vocals. But hey, maybe the technology will continue to develop, giving more options eventually.

      Delete
    2. Actually, you can remove the double-tracked vocals from the Esher demos easily. Spleeter will create a stereo vocal track. Just remove one channel to have a single set of clear vocals.

      Delete
    3. Really? Can you test it and send me an example?

      Another possibility has come up since I posted this album, and that's X-Minus's ability to split the backing vocals from the lead vocals. I'm not sure how it does this, but I figured out from testing that it removes whichever vocal is not the loudest. So that might work.

      Delete
    4. Sure Paul. How can I contact you directly?

      Delete
    5. This comment has been removed by the author.

      Delete
  5. the zep experiment is horrible. its in no way listenable. however you picked a song with effects on it, which in turn causes it to sound worse when brought up in the program because it can't be taken off. off the top of my head the program may be best for straight recorded songs, such as acoustic, demos, maybe acoustic live if the audience is quiet, etc...

    ReplyDelete
    Replies
    1. Yeah, that one has issues. I think the voice was mixed so low, plus it was blended in with the music with effects, that it couldn't be pulled out from the music that well. What do you think of "Watch That Man?" I think that worked better.

      Delete
  6. Wonder how this would work with Oasis albums which were layered with so many guitars and overdubs and of course mastered really loud?

    ReplyDelete
    Replies
    1. Yeah, that would be problematic. Oasis records are really messed up with brickwalling, etc... It would be great to have the multitrack versions - probably some fixes could be done with those.

      Delete
    2. https://blonderazorblade.blogspot.com/?m=1

      This website has remastered Oasis albums using software to un brick wall them. Music tech is really amazing

      Delete
  7. This seems like a nice tool that would benefit from further development. I would love to be able to take soundtracks versions of Pink Floyd's The Wall and strip the nonmusical film sounds for a clean music track on songs such as What Shall We Do Now? and In The Flesh? but it seems that would be beyond the current limitations.

    ReplyDelete
    Replies
    1. It might be possible in some cases, depending on what was happening in the song at that moment. Also, there's a 5.1 surround sound version of that soundtrack. I've messed around with some of those versions for my still unposted Wall project. Sometimes you can strip non-musical sounds from that. But again, it depends on the exact situation. If one really worked at it using both methods, one could get further.

      Delete
  8. Haven't listened to them lately (coz the sound is horrible) ... the Replacements. Great songs, muffled sound. Anything you can do?

    ReplyDelete
  9. This comment has been removed by the author.

    ReplyDelete
  10. What about early REM? Murmur and Reckoning could sound good stripped back to Stipe and Buck.

    Similar Robyn He's Element of Light / Fegmania would benefit greatly from a lack of 80s production

    ReplyDelete
  11. Oh yeah, "still unposted Wall project" is nearly a year late...

    Thanks for what you do here, Paul. Ahem, da Floyd. Cheers!

    ReplyDelete
  12. Lots of Bob Seger songs are piano led, could be an interesting project.
    Andy

    ReplyDelete
  13. Spleeter is fantastic technology, I have used it with some remix/covers. Here's one I did with using Johnny Cash's original vocals over a different arrangement (https://youtu.be/Uly9WReBJ9Q) The possibilities are endless, and blur the lines between cover and tribute.

    ReplyDelete
    Replies
    1. I kept swinging between hating it outright (because ala Dylan with Hendrix taking 'Watchtower' and making it his, as huge a NIN fan as I am, Cash stole the song without pulling a gun, and Reznor has said as much himself LOL), and wondering what he would sound like over the original NIN track, or the 'quiet' remix, which your tribute/remix evokes to me in a way...I'm surprised Spleeter hasn't already become de rigeur in the indy rap biz, since this essentially makes accapellas for remixes and instrumentals for freestyles, from ANY album or song you want (within the capabilities of the program, of course).

      Delete
    2. Agreed. No longer are the original stems required.

      In generally, I use the technology to put apart older recordings where the original stems no longer exists. It's not perfect but still impressive, especially on the vocals. I just finished one for a Leadbelly track where the original was quite noisy.

      Delete
  14. would love to hear a 'fixed' version of AC/DC's Blow Up You Video. Especially the single 'Heatseeker'. Horrendously mixed vocals.

    ReplyDelete
  15. hi,love your site .i think solo beatle songs sound more beatley pared back ,particularly wings poppier efforts.another secret ive found is to speed up or slow down songs.some indifferent hollies tunes turn into psychedelic masterpieces...ish

    ReplyDelete
  16. I am curious now as to whether the legend SonicLoveNoize is aware of this program, and just what alchemy he could make with it...

    ReplyDelete
  17. I would love to hear Radiohead's Creep with that distracting guitar's volume lessened greatly. I know it adds to the song, but it kills my ears in my headphones

    ReplyDelete
  18. The Move's "Live At Fillmore" release, being a soundboard recording, has way too much vocal, and not nearly enough guitar. I played around with separating the main mid-range vox-gtr frequencies on "Open My Eyes" and compressing the hell out of them, which was somewhat successful, but I bet you could do better with this tool.

    ReplyDelete