HISE Logo Forum
    • Categories
    • Register
    • Login

    8 Times more CPU consumption on Aida-X Neural Models

    Scheduled Pinned Locked Moved General Questions
    48 Posts 14 Posters 2.4k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      ccbl @Christoph Hart
      last edited by

      @Christoph-Hart cool. Well like I said, if you want any kind of models for testing, let me know. I can do either NAM-wavenet or LSTM, of any size.

      1 Reply Last reply Reply Quote 0
      • C
        ccbl @Christoph Hart
        last edited by

        @Christoph-Hart One thing, in the Neural Example in the docs it says this "It requires HISE to be built with the RTNeural framework to enable real time inferencing..."

        I don't remember doing this explicitly when I built HISE, I just built it the standard way and it all works. I'm assuming this is just no longer a requirement? Otherwise could it explain the performance penalty?

        1 Reply Last reply Reply Quote 0
        • DabDabD
          DabDab @orange
          last edited by

          @orange said in 8 Times more CPU consumption on Aida-X Neural Models:

          @DabDab I haven't trained any model yet, but loading models is done like this:

          • Open the Neural Sine synth example in the Snippet Browser. Delete the synth.
          • Then replace the sine example with one of the models above (the models are in json format, just copy/paste).
          • Then open the neural node in FX as Scriptnode, select the model then you're good to go.

          When you replace the neural network, you might need to restart HISE after saving, sometimes it doesn't update.

          Wow... i will give it a try. Later I will need @griffinboy help.

          Bollywood Music Producer and Trance Producer.

          1 Reply Last reply Reply Quote 0
          • S
            scottmire
            last edited by

            @orange I am probably doing something wrong, but when I try to make this work, HISE crashes. Here is my process:

            • I copy the NN code from the Sine synth example into the interface onInit script in my project
            • I replace everything in the obj declaration with the .json from one of your AIDA-X captures
            • I add a scriptnode math.neural node in FX
            • I select the NN obj in the dropdown
            • Hise crashes.

            Any thoughts?

            1 Reply Last reply Reply Quote 0
            • JulesVJ
              JulesV
              last edited by JulesV

              @Christoph-Hart Has there been a fix for this?

              Christoph HartC 1 Reply Last reply Reply Quote 0
              • Christoph HartC
                Christoph Hart @JulesV
                last edited by

                @JulesV I pushed the preliminary work I had on my mobile rig but it‘s not usable as it is. I‘ll need to do a few more performance tests and cleanup.

                JulesVJ A orangeO FortuneF 4 Replies Last reply Reply Quote 2
                • JulesVJ
                  JulesV @Christoph Hart
                  last edited by

                  @Christoph-Hart Thank you.

                  I see you also added ONNX. I'm not sure if we can open NAM models in ONNX, but it would be great to be able to load and run NAM models with performance.

                  1 Reply Last reply Reply Quote 0
                  • A
                    aaronventure @Christoph Hart
                    last edited by

                    @Christoph-Hart 3417c3ca-b4cc-42d4-a91f-77d28f66fb4c-image.png

                    peak developer humor

                    Christoph HartC 1 Reply Last reply Reply Quote 1
                    • Christoph HartC
                      Christoph Hart @aaronventure
                      last edited by

                      @aaronventure haha I would love to be as funny as this, but in this case my old keyboard with the defect d key pranked me one last time... but damn that's a solid joke.

                      1 Reply Last reply Reply Quote 1
                      • orangeO
                        orange @Christoph Hart
                        last edited by

                        @Christoph-Hart said in 8 Times more CPU consumption on Aida-X Neural Models:

                        @JulesV I pushed the preliminary work I had on my mobile rig but it‘s not usable as it is. I‘ll need to do a few more performance tests and cleanup.

                        Has this issue been resolved? I still observe the same situation in the current commit.

                        develop Branch / XCode 13.1
                        macOS Monterey / M1 Max

                        1 Reply Last reply Reply Quote 0
                        • FortuneF
                          Fortune @Christoph Hart
                          last edited by Fortune

                          @Christoph-Hart said in 8 Times more CPU consumption on Aida-X Neural Models:

                          @JulesV I pushed the preliminary work I had on my mobile rig but it‘s not usable as it is. I‘ll need to do a few more performance tests and cleanup.

                          Almost 6 months passed. The problem still persists. Why is the neural node still unusable after all this time?

                          You need to solve this problem as soon as possible, my friend.

                          Christoph HartC 1 Reply Last reply Reply Quote -1
                          • Christoph HartC
                            Christoph Hart @Fortune
                            last edited by

                            @Fortune just don't use it then.

                            FortuneF 1 Reply Last reply Reply Quote -1
                            • FortuneF
                              Fortune @Christoph Hart
                              last edited by Fortune

                              @Christoph-Hart said in 8 Times more CPU consumption on Aida-X Neural Models:

                              @Fortune just don't use it then.

                              Wow, what an amazing answer you gave as the creator of HISE :)))

                              It has nothing to do with me bro, the question is this:

                              Will the Developers be able to use Neural networks with HISE or not?

                              Will your HISE be compatible with the future or not? That is the question.

                              It is obvious from your answer that you have failed to solve the source of the problem. But by acting like this, all you will do is alienate people and ruin your potential future businesses, nothing else.

                              LindonL 1 Reply Last reply Reply Quote 0
                              • LindonL
                                Lindon @Fortune
                                last edited by

                                @Fortune said in 8 Times more CPU consumption on Aida-X Neural Models:

                                It has nothing to do with me bro,

                                Then I guess its not a problem.

                                HISE is an open source project - you cannot expect any given piece of functionality to get added and to be supported because you want it.

                                However you are not stuck with the whims of @Christoph-Hart , if there's something you want and Christoph has not built it or not completed it to your satisfaction - then you can go build it yourself.

                                HISE Development for hire.
                                www.channelrobot.com

                                Christoph HartC 1 Reply Last reply Reply Quote 3
                                • Christoph HartC
                                  Christoph Hart @Lindon
                                  last edited by

                                  I'd rather remove the entire RT Neural framework from HISE so it doesn't raise false expectations, but it's way down on my priority list to spend any time on that issue and your communication skills just pushed it way further down.

                                  15 upvotes to this post and that shit is gonzo.

                                  ustkU orangeO Dan KorneffD 3 Replies Last reply Reply Quote -1
                                  • ustkU
                                    ustk @Christoph Hart
                                    last edited by

                                    @Christoph-Hart please don’t get away from implementing this, at whatever pace fits with your calendar. I understand the frustration of getting such behaviour from frustrated people, but one is not all. We all expect new stuff, fixes, and that "bloody function only I can dream about even if takes the rest of your life working like a mule to implement it and that I will just play with once and say « arrff… I finally don’t need it… » "

                                    It is for sure something many of us are counting on, but teaching you on the way you have to do your job is not a correct behaviour.

                                    As @Lindon said, since Hise is open source, one cannot hard claim a function he cannot implement by himself, but kindly ask, expect, cross fingers, and raise votes for his party.

                                    Empathy, Hise, and ♥♥♥ are the first building blocks for a better world!

                                    Can't help pressing F5 in the forum...

                                    LindonL 1 Reply Last reply Reply Quote 5
                                    • LindonL
                                      Lindon @ustk
                                      last edited by

                                      @ustk yeah thats what we really want; more votes for partying....thats what you meant right?

                                      HISE Development for hire.
                                      www.channelrobot.com

                                      ustkU 1 Reply Last reply Reply Quote 1
                                      • ustkU
                                        ustk @Lindon
                                        last edited by

                                        @Lindon exactly, it’s my English that is gonzo 😆

                                        Can't help pressing F5 in the forum...

                                        LindonL 1 Reply Last reply Reply Quote 0
                                        • LindonL
                                          Lindon @ustk
                                          last edited by

                                          "gonzo" - word of the day!

                                          gonzo
                                          /ˈɡɒnzəʊ/
                                          adjectiveinformal•North American
                                          1.
                                          relating to or denoting journalism of an exaggerated, subjective, and fictionalized style.
                                          2.
                                          bizarre or crazy.

                                          HISE Development for hire.
                                          www.channelrobot.com

                                          d.healeyD 1 Reply Last reply Reply Quote 0
                                          • orangeO
                                            orange @Christoph Hart
                                            last edited by orange

                                            @Christoph-Hart This is a feature that many of us want, not just one person, please don't let the nervous attitudes and communication errors of some people prevent its development.

                                            Because this promising feature will positively impact the entire product development workplace. And as you will appreciate, when the industry is just starting to use it and it's possible to make great products that haven't been done before, there's no point in removing it just for that reason.

                                            Whenever you are available, it's ok. We all love your work. Just keep doing what you're doing, just like you did before.

                                            develop Branch / XCode 13.1
                                            macOS Monterey / M1 Max

                                            1 Reply Last reply Reply Quote 2
                                            • First post
                                              Last post

                                            57

                                            Online

                                            1.7k

                                            Users

                                            11.7k

                                            Topics

                                            102.1k

                                            Posts