HISE Logo Forum
    • Categories
    • Register
    • Login

    Dynamically load instruments over the Internet?

    Scheduled Pinned Locked Moved Solved General Questions
    18 Posts 2 Posters 1.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • bthjB
      bthj @d.healey
      last edited by

      @d-healey Great! I'll look into those as well.

      bthjB 1 Reply Last reply Reply Quote 1
      • bthjB bthj has marked this topic as solved on
      • bthjB
        bthj @bthj
        last edited by bthj

        Now I have written some code towards this functionality - a milestone for me, as this is the first thing I've actually done with HISE.  Really enjoyable getting to know this project and community.

        What I've done so far is:

        • hardcode a list of sample map IDs, to be dynamically fetched via some API endpoint
        • when not available locally, download the corresponding samples monolith HLAC to the Samples folder
        • then fetch the sample map Base64 encoded and load it into the Sampler

        The task in the last bullet is done every time a sample map is selected (for now via combobox), which wastes a bit of network resources (and I have to choose Tools -> Clear all Samplemaps, so they won't be saved in the archive/xml).  It would be good to save the sample map in the filesystem, like the HLAC monoliths, and maybe just download it as xml rather than base64 encoded, but there doesn't seem to be a Special Location for the SampleMaps folder.  Is there some way to obtain a filesystem reference to that folder, as a target for Server.downloadFile?

        Here's the code I've written so far:

        // sampler
        const var Sampler = Synth.getChildSynth("Sampler").asSampler();
        
        // sample maps array
        const var sampleMaps = [
          "fg_01FFRFAGFF9M9R8D6AWHTX7XB9",
          "fg_01FNAAJA8CXA8CNAXAGVWJN0HA"
        ];  // TODO: fetch samples list from some API endpoint, instead of this hardcode
        
        // Internet communication
        Server.setBaseURL("https://storage.googleapis.com");
        
        // combo box
        const var cmbSampleMap = Content.getComponent("cmbSampleMap");
        cmbSampleMap.set("items", sampleMaps.join("\n"));
        
        
        // sample map selection
        
        // - sample map downloaded as base64 and loaded into a Sampler
        inline function fetchAndLoadSampleMap( sampleMapId ) {
        	local sampleMapBase64FileName = sampleMapId + ".txt";
        	Server.callWithGET( 
        		"/synth_is_samples/map/" + sampleMapBase64FileName, 
        		{}, 
        		function(status, sampleMapBase64) {
        			Console.print("sample response: " + sampleMapBase64);
        			Sampler.loadSampleMapFromBase64( sampleMapBase64 );
        		}
        	);
        }
        
        // - combo box callback with conditional  
        // samples monolith download and  storeage in filesystem
        const var samplesFolder = FileSystem.getFolder(FileSystem.Samples);
        inline function oncmbSampleMapControl(component, value)
        {
        	var sampleMapId = sampleMaps[value-1];
        	
        	// ensure samples monolith is available
        	local samplesFileName = sampleMapId + ".ch1";
        	local samplesFile = samplesFolder.getChildFile( samplesFileName );
        	Console.print("samplesFile: " + samplesFile.isFile());
        	if( ! samplesFile.isFile() ) { // we need to download the file
        		Server.downloadFile(
        			"/synth_is_samples/hlac/" + samplesFileName, 
        			{}, 
        			samplesFile, 
        			function() {
        		    	var message = "";
        		    	message += Engine.doubleToString(
        		    		this.data.numDownloaded / 1024.0 / 1024.0, 1
        		    	);
        				message += "MB / " + Engine.doubleToString(
        					this.data.numTotal / 1024.0 / 1024.0, 1
        				) + "MB";
        		    
        		    Console.print(message);
        			
        			if( this.data.finished && this.data.success ) {
        				Console.print( "Samples loaded" );
        				fetchAndLoadSampleMap( sampleMapId );
        			}
        		});
        	} else { // samples monolith is present, so we can go ahead and load the sample map
        		fetchAndLoadSampleMap( sampleMapId );
        	}
        };
        
        • and a snippet of the project:
        HiseSnippet 2568.3oc4YrsaabbcojWCSZ2Tmf7PeoESYKBnfk4MKqKV0wh5BsUrtAQ5KAoFBi1cH4Ts6NK1YVIwFHfh9Wj25mP+AJPds+M4On8blcWtConTUDRBRPIfL4bl4Lm62FePjvgIkhHqBE6NLjYU3A1cFFnFrw.JOvZ6MsJ76rOidJ6DtmK6HI0OzicjOM7HOA0kGz2Z8ggToj4ZUnvruDwoPw6Xo+7cuXcpGMvgkCxx5sBtCaGtOWkC8f0dM2yqM0k0k6ab5EVaaGQvFBOQLveyZW2Jj5bBsOaOJdrYrsJb2sb4JQTGEUwjVEty5B2gcFHNKH47ukK4G6wvEMr5.WTB31BPXbSfZsw.PzNHSOHsrJXePtVY1DsxmZuK2kOBdt14g5MH4XXpOJLy3r2riwdMLYu5Fr2TXoBFrzcRXoO1tiSDOTkuCxO22d6.EKpGET6lrRxYsl4ece6MDvIBTU8omvZGAKFgQkEqWedRy50ma0RkpUijXtiJAVAohbJMhzIAB44DsWR09LklY0qpTNc6xyUkJS+ckz6p69at+yHC.CHQIfuOkQnADd.WwoddCINdL39SnHAbv.bRugp5sRVrKMrxXLGdTIgFEQGZvlxrCKANEOb1UA76nKZGtTgW1WUhPJ2q+Q0azt8gsa8x1sWY2UNb4MWr06dU22uz6Wekxymej8Z05KZs7FuG9auVuu0Ke669h8p+pVkK8gUIjQxYOlxYPJaHId.kH8hD9DovmQZcv1DVfanfGnlGTAREi5RD8HpAbInZhbcDtLsPpMMALEwQ36GGvcnJtHnTGVzofzHYp0oR1aNbmJkGnTgxmUqlD72fPjp8Eh9fdKjKqB3VNUoA+7XA4Xw4FJKG+iGoS.0Ul6AZZE9gh.XQkxlGBuLy0HeToLWw7kkm2P2W8u.RXkx+4fxycIaFQx7XNZggG3wCXjdwA50I5tVAt6.YXxs54261tj4HecohdBGpWNXTSr3Bs4d5zCffXhviHkqpNWUd0RES0c.tduiqF7xs5VgTpXwx0jnO7QbYZVNYMfMqUFP8JHw7HZe8E5uxX9JRHTOVN+j3nY3hEAcqT3wpFFwQkZp5HhIA0rj8LxTnFn4.Dy7e8L0IPvqexgpLIVDMZWTpH78EktTjgTmADCiQgoyPvCzGM3IfqX.LgXR3ZlzLIBL8APulHgWEmLWl4Ax4EylqDH3FAfiI.Ux8U9J8oebiOfLdohiEDC1OCqY9Q0mDtaVfLNhMJZyWDH7.KKABlnmR4dTHG63tKxqwMwYPCzM4RGezQSUdix8gaV4RWLJGS0bqOhooVCnJW+UELRoHuWExuep6hd9XVlyXj.FyESk5BkSPsJj8.rNbTTy7wy1RiK5FMEm7AdTmZSvLi7tybuKZrYBfQN7Id1D3i1n4CkhfzOfxpLpES1HC3idNYqf9fWDvYwfQoqniBTM8qjcvhXFvptTEsZPr+lorOHm0HMp2bgp0G8i4IMxPJIBwjHk2cc3fnPckjq3DzpqPAl6qfLEKNG5Zr65iDozuF2.mxAI7C9GZGyoROnXmb.HLe1mY.UF6fkuIoYHlvmgjVREpgnUDkIoR6MIIo9jWf4AvedAg4IYItOSKTIDRCoiakBz8xApN2WPnCvZSz.WxHeLiZz2X9.xAoCUybZOixgJhhHBkfIhOFZK3YDRVMLWgirJngXUowtbQMot4Evxk+qGCU1RWERCXd03AtryqNP468GfxQocmlc2HsmdtWPJRhEmVGBsjooWwnxKfRX2jZiX0vzrgajR9JSMWIVSTWUbiXnnsO+uxzp2SXCOV.8.Pd7UpO3H9tw5.vZJn63Z9wRtyig55ZMPIPyVgCwf0WkvI+IRilKA+3QORmLFbJ4jOG1C8CgceNYgFyUB8lQGvz.FPFdMaXRq2U3ySpedyls0elaUs+O9OWn+WzqJEcc33UdCKsTc8GPtSv9hjFCwldbXXiNRsBHhF.gwbnBSbDIzKFtNxYf4UbFohbnuOSEMTma+LF1N0b4cWlS5cDvlHCzUrIWF5QGV4IqL2pFEu1SnX6CouPUx3tF6lDFiFY7P6E6eL1FqtRJYxanWujqXh8RMw59emx13bNQWGhUBzT0rHJdPn4+wmnv9pmnvbfGmD+ViCJB1FZ8d+PVvUMFjUpyNN8QJWAGUom83goydrA1N45hys3vPFejsoStklyMmFz5MauIjwK69fqFHWHKRwQIovlrSgQCSlson8lL4IJQHLk2n.MqB26lS8yyo7mu1PyYJ08oZU341WaK+kt1t8s7o.ArKLCbimwcUCFQf+1IqMfw6OPYReKCY3ApzAJSjg1PlJLeVWnxpVN901lfZXJHVVFBxWt13D9a+6Whve4Zo54DkZI6WmlZw539YSU+.6EZt7BKs3JOY45VnpIai6auvSatxxKr7SZX.uYBFqrvJKtTyUdpk1fNyGJXiA+kg6+cHSU9YjFXwSDVZ329NJXjujXIX6dTHqgdeHREPC.kb7WwSVAorzqSxM9xHZ3.tibLL2j0iF6oZEFBiGhuy.rqJJNYy0g1ZNAtpCwAlvau5hqn+r7x0WZk5K0Pepth9vPR6BSaM1MiizCi3G.0UPVQC6MR1agAVDQF7xHpAa11ip5nF5MwMcvVYJ8IgCgvQpbpzLC9VAtFzdwRWXoXmqLeEDqK+X.OzFDhXfEF+sIvGjIcCH8xXOH.NYYfjqFZFh9C1CVbSYwO19.Nz.wz4wYlBOBYO9wfGSelmek8V85AV4bF7N1se+ONuoiI4+sIj+SrgFTYTeH3OscDMOTzNa0O.O1V3M9w1NHhomVCZLI+Xe6ZqGCpnnwg9OWSSpV9h3fwnUJieHChQUXbV9l2asCO7kQh3vIw56dg1mnaDDAiuvnwF6Gv.UsxTF2HRHk8.wQeWRysNHNpOpqxgbHCFKRNNLHmTZ7FVOsPA.DDNilWtytTXfgwx.qoR8tTsIdF6j0MlXcyIV+jIVuvDqe5DqWbh0KkudTENzw.eAzIZH3t2rFBfK3.rsYiStNued4SMj+GOS5c+Y2yj9KfDii8RtEy3wNbTwuUvoPDG.A4wOwNs9VFzFiwk6BStENPDvcF2+F7W62mEYx6SJP+iu4a92unkRAgW4G6SW6PlGCl1IGzebscftooQiG198RWz368qZOU60uwNgcIXJKxubKnM6+2TP65TQeTZ4LhtCneFZCefsNqKAKR9SI6cnHF66OqniMTYpCTM1gYVeBG4HcccbMxDcXAt5E+G3S5lMxJlga1HaSKmrqBjmzeq6guvrr.rHituKOnLomoKpDp4irDTv4mDtzm5DINxIYpSjWumFBvkA5+q+JZuKtlzHaJSa65Uqa4C0XNxwAcxeLTxZ53z7VfyStE3rvs.mmdKvYwaANKcKvY4qEGr7dqXXTsjjd.fC1JwwpvVibrl05+hLTr5H
        
        d.healeyD 1 Reply Last reply Reply Quote 0
        • d.healeyD
          d.healey @bthj
          last edited by

          @bthj Since the samples maps are predefined anyway why not just include them with the plugin instead of downloading them?

          Libre Wave - Freedom respecting instruments and effects
          My Patreon - HISE tutorials
          YouTube Channel - Public HISE tutorials

          bthjB 1 Reply Last reply Reply Quote 0
          • bthjB
            bthj @d.healey
            last edited by bthj

            @d-healey The aim is not to have the sample maps predefined, but generated mechanically.

            For a bit of a context: I'm exploring those possibilities for the synth.is project, where you can evolve sounds[1], render them as sample packs and currently download them along with programmatically generated SFZs[2]. Many things broken there and I aim to continue working on this research project in the coming years, but all are very much welcome to play with this (I know the interactive evolution part is broken, which is a regression resulting from work on quality diversity search for sounds - I welcome requests for accelerated fixes : )

            Just as SFZs can currently be rendered and downloaded, it would be nice to be able to obtain those sounds directly in a plugin.

            [1] https://youtu.be/dm2cgPqQVP0
            [2] https://youtu.be/3eLo8qORiMQ
            (YouTube links here as inlining above was causing problems)

            bthjB 1 Reply Last reply Reply Quote 1
            • bthjB
              bthj @bthj
              last edited by

              The approach I have currently implemented is maybe ok - sample maps are not large so redundant downloading isn't a big problem - but if it is possible to persist them in the plugin folder structure, then it would be interesting to try that out as well.

              d.healeyD 1 Reply Last reply Reply Quote 0
              • d.healeyD
                d.healey @bthj
                last edited by

                @bthj said in Dynamically load instruments over the Internet?:

                The approach I have currently implemented is maybe ok - sample maps are not large so redundant downloading isn't a big problem - but if it is possible to persist them in the plugin folder structure, then it would be interesting to try that out as well.

                You could write the string to a file.

                Libre Wave - Freedom respecting instruments and effects
                My Patreon - HISE tutorials
                YouTube Channel - Public HISE tutorials

                bthjB 1 Reply Last reply Reply Quote 0
                • bthjB
                  bthj @d.healey
                  last edited by

                  @d-healey Wouldn't it be best placed in the SampleMaps folder? - then I'm wondering how to get a filesystem handle on that folder.

                  bthjB d.healeyD 2 Replies Last reply Reply Quote 0
                  • bthjB
                    bthj @bthj
                    last edited by bthj

                    Tried something like:

                    samplesFolder.getParentDirectory().getChildFile("SampleMaps").getChildFile(sampleMapFileName);
                    

                    which works, so I'll probably go that route, if it isn't some kind of an anti-pattern?

                    1 Reply Last reply Reply Quote 0
                    • d.healeyD
                      d.healey @bthj
                      last edited by

                      @bthj said in Dynamically load instruments over the Internet?:

                      @d-healey Wouldn't it be best placed in the SampleMaps folder?

                      There is no sample maps folder once your project is compiled to a plugin, all the sample maps are embedded in the binary.

                      Libre Wave - Freedom respecting instruments and effects
                      My Patreon - HISE tutorials
                      YouTube Channel - Public HISE tutorials

                      bthjB 1 Reply Last reply Reply Quote 0
                      • bthjB
                        bthj @d.healey
                        last edited by

                        @d-healey Thanks for the insight. Then it makes sense that there is no Special Location FileSystem constant for that folder. I'll just download the sample maps to the Samples folder, alongside the monoliths, Base64 encoded for loading with Sampler.loadSampleMapFromBase64.

                        bthjB 1 Reply Last reply Reply Quote 0
                        • bthjB
                          bthj @bthj
                          last edited by

                          The above procedure of downloading the files to FileSystem.Samples works fine, until running on iOS, where the Samples folder seems to be part of the read-only app bundle. So downloading to FileSystem.Documents might be a better idea, but after loading the sample map, the Sampler seems to be fixed on searching for the files in FileSystem.Samples.

                          Is there some way to instruct Sampler to look for the (monolith) samples in FileSystem.Documents?

                          bthjB 1 Reply Last reply Reply Quote 0
                          • bthjB
                            bthj @bthj
                            last edited by

                            Made a couple of changes which solve this issue on iOS, discussed here:

                            Link Preview Image
                            Dynamically download samples on iOS · Issue #265 · christophhart/HISE

                            Downloading samples into the FileSystem.Samples directory doesn't work on an iOS device (though it works on a simulator), where the Samples folder seems to be part of the read-only app bundle. A couple of changes solve this particular is...

                            favicon

                            GitHub (github.com)

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post

                            10

                            Online

                            1.7k

                            Users

                            11.8k

                            Topics

                            103.1k

                            Posts