HISE Logo Forum
    • Categories
    • Register
    • Login

    CPU usage during compilation

    Scheduled Pinned Locked Moved General Questions
    38 Posts 10 Posters 1.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • d.healeyD
      d.healey
      last edited by d.healey

      I just tried lld, seems it might be a bit faster at linking but I'd need to do some proper benchmarks to know for certain.

      In case anyone else (or future Dave) is thinking of using lld (or gold) for linking here is what you need to do:

      Put the following in the Extra Linker Flags box in Projucer

      For lld:
      -fuse-ld=lld
      

      With lld you need to use Clang instead of GCC. So the make command will look something like: make CXX=clang++ CONFIG=Release -j 6

      For gold:
      -fuse-ld=gold
      -Wl,--threads
      -Wl,--thread-count=6
      

      Libre Wave - Freedom respecting instruments and effects
      My Patreon - HISE tutorials
      YouTube Channel - Public HISE tutorials

      1 Reply Last reply Reply Quote 0
      • d.healeyD
        d.healey
        last edited by d.healey

        I've tried both of these linkers so far and have had no success in improving compile times.

        For some reason, which I can't work out, clang + lld will compile and link but the linking is still only single threaded. @Christoph-Hart Any ideas?

        With gold the compiling via GCC works but the linking fails with an error - I haven't dug into this one much more because it seems lld is the better of the two.

        Libre Wave - Freedom respecting instruments and effects
        My Patreon - HISE tutorials
        YouTube Channel - Public HISE tutorials

        1 Reply Last reply Reply Quote 0
        • Christoph HartC
          Christoph Hart
          last edited by

          I think the newest script node version compiles a little bit faster because the template system is a little bit less complex, but in my experience the only way to really speed up compile times is to get a better system :)

          d.healeyD 1 Reply Last reply Reply Quote 0
          • d.healeyD
            d.healey @Christoph Hart
            last edited by

            @Christoph-Hart Compile time is fine, it's the linking that's the problem, it only uses a single thread.

            Libre Wave - Freedom respecting instruments and effects
            My Patreon - HISE tutorials
            YouTube Channel - Public HISE tutorials

            1 Reply Last reply Reply Quote 0
            • d.healeyD
              d.healey
              last edited by

              Finally solved the linker threading thing.

              Add this to the Extra Linker Flags section -flto=auto :D

              Libre Wave - Freedom respecting instruments and effects
              My Patreon - HISE tutorials
              YouTube Channel - Public HISE tutorials

              ustkU 1 Reply Last reply Reply Quote 2
              • ustkU
                ustk @d.healey
                last edited by ustk

                @d-healey Nice one! Is that linux only?

                EDIT: oh yes it's linux... I wonder if I can speed up the process on mac too...

                Can't help pressing F5 in the forum...

                d.healeyD Y 2 Replies Last reply Reply Quote 0
                • d.healeyD
                  d.healey @ustk
                  last edited by

                  @ustk I think Xcode already does multi-threaded linking.

                  Libre Wave - Freedom respecting instruments and effects
                  My Patreon - HISE tutorials
                  YouTube Channel - Public HISE tutorials

                  1 Reply Last reply Reply Quote 0
                  • Y
                    yall @ustk
                    last edited by

                    @ustk mac je met 1h pour un vst. Windows 4 minutes. Ça rend ouf

                    Matt_SFM 1 Reply Last reply Reply Quote 0
                    • Matt_SFM
                      Matt_SF @yall
                      last edited by

                      @yall pareil. 1/2 an hour on my mac (Intel i7) , 5mins on pc

                      Develop branch
                      Win10 & VS17 / Ventura & Xcode 14. 3

                      1 Reply Last reply Reply Quote 1
                      • d.healeyD
                        d.healey
                        last edited by

                        How many threads are you guys using for your builds?

                        Libre Wave - Freedom respecting instruments and effects
                        My Patreon - HISE tutorials
                        YouTube Channel - Public HISE tutorials

                        oskarshO Christoph HartC Matt_SFM 3 Replies Last reply Reply Quote 0
                        • oskarshO
                          oskarsh @d.healey
                          last edited by

                          @d-healey

                          I am using all threads -2
                          f06ee91c-7998-4868-82d8-b7699931c5bb-image.png

                          I am building using the batchCompile

                          make CONFIG=Release AR=gcc-ar -j`nproc --ignore=2`
                          
                          d.healeyD 1 Reply Last reply Reply Quote 0
                          • Christoph HartC
                            Christoph Hart @d.healey
                            last edited by

                            @d-healey said in CPU usage during compilation:

                            How many threads are you guys using for your builds?

                            Yes. :)

                            1 Reply Last reply Reply Quote 3
                            • d.healeyD
                              d.healey @oskarsh
                              last edited by

                              @oskarsh I was asking the Mac guys who are saying their builds are slow. :)

                              Libre Wave - Freedom respecting instruments and effects
                              My Patreon - HISE tutorials
                              YouTube Channel - Public HISE tutorials

                              1 Reply Last reply Reply Quote 0
                              • Matt_SFM
                                Matt_SF @d.healey
                                last edited by

                                @d-healey Just 1 thread here. Do you know if there's a way to change that ?

                                Develop branch
                                Win10 & VS17 / Ventura & Xcode 14. 3

                                d.healeyD 1 Reply Last reply Reply Quote 0
                                • d.healeyD
                                  d.healey @Matt_SF
                                  last edited by

                                  @Matt_SF That explains it. There is definitely a way but I can't remember how. Google will help you here :)

                                  Libre Wave - Freedom respecting instruments and effects
                                  My Patreon - HISE tutorials
                                  YouTube Channel - Public HISE tutorials

                                  Christoph HartC 1 Reply Last reply Reply Quote 1
                                  • Christoph HartC
                                    Christoph Hart @d.healey
                                    last edited by

                                    @d-healey I think the problem is that on macOS the linker (ld) is only single threaded (at least here) and you can't replace it with another linker easily.

                                    Christoph HartC 1 Reply Last reply Reply Quote 0
                                    • Christoph HartC
                                      Christoph Hart @Christoph Hart
                                      last edited by

                                      -flto=auto

                                      Setting the link time optimization to auto is not the solution as it might just deactivate it (depending what auto means) and sure then you decrease the build time but you end up with a bigger and less optimized binary. The link time optimization (lto) is the step that takes the most time which is why I deactivated it on the CI test build of the demo project so that the macOS test suite runs as fast as the Windows one.

                                      d.healeyD 1 Reply Last reply Reply Quote 0
                                      • d.healeyD
                                        d.healey @Christoph Hart
                                        last edited by

                                        @Christoph-Hart

                                        Setting the link time optimization to auto is not the solution

                                        Works here on Debian. If that option is available on Mac you can replace auto with the number of threads you'd like to use.

                                        Libre Wave - Freedom respecting instruments and effects
                                        My Patreon - HISE tutorials
                                        YouTube Channel - Public HISE tutorials

                                        1 Reply Last reply Reply Quote 0
                                        • First post
                                          Last post

                                        19

                                        Online

                                        1.7k

                                        Users

                                        11.9k

                                        Topics

                                        103.3k

                                        Posts