305 pointsby lumpa8 days ago12 comments
  • ironhaven2 days ago
    What RISC-V extensions is this built for? There is a target triple of riscv64-unknown-linux-gnu listed so i assume the baseline RV64GC that the Linux kernel is built against.

    It makes sense to be conservative with a new architecture but new high performance RISC-V cores such as from SiFive[1] are going to meet RVA23. That standard has vector and bit manipulation extensions that could be used to improve performance with a python interpreter. I guess more testing needs to be done to see if raising the bar is useful.

    [1]https://www.sifive.com/cores/performance-p800

    • emmatyping2 days ago
      Speaking unofficially, opinions my own, etc.

      We (CPython) currently only have access to RV64GC machines to test on, and so that is the defacto target we can currently support.

      Personally, I hope to see RVA23 become the baseline in the future. But that will depend on adoption.

      On the packaging side of things, the platform tag is manylinux_X_Y_riscv64. So far that has meant RV64GC. So before we set a baseline of RVA23, we will need to see where the community lands.

      • ccgreg2 days ago
        How is this different from x86_64 and aarch64? Or even the various Alpha and Mips64 chips.
        • Marcuss22 days ago
          For example x86_64 has v1, v2, v3 and v4 baselines, this tells you which instructions they support (e.g. v4 has AVX-512, v3 has AVX2, etc.).

          RISC-V RVA22 and RVA23 aren't too different in this regard. Each one prescribes which extensions must be supported by the processor. I saw RV64GC mentioned, this is just a shortening of RV64IMAFDC, so I for baseline instructions, M for multiplication and division, A for atomic, F for floating point, D for double precision floating point and C for compressed instructions.

          You can have a baseline E profile instead of I (less registers, some other features stripped), but I don't think we will ever see manufactured RV64E core, trough RV32EC cores exist.

          • jdc-puba day ago
            Huh, where does the “G” come from in RV64GC?
          • cbm-vic-202 days ago
            The E extension will probably only ever appear in softcores (FPGA) to reduce gate count.
            • Marcuss22 days ago
              CH32V003 has RV32EC core, for RV64, yes, there is no point.
          • ccgrega day ago
            Another aspect of the x86_64 architectural swamp is that Intel deliberately makes their optimized math libraries fail if run on a chip that is not 'INTEL INSIDE'. That block totally ignores cpu feature bits.

            I've always wondered if virtualization software vendors made everything claim to be INTEL INSIDE, just to avoid this problem.

            • Marcuss219 hours ago
              I know the RPCS3 (PS3 emulator) encountered some differences in a floating point instruction where Intel and AMD had different precision, causing de-synchronizations in LittleBigPlanet multiplayer.

              Could be down to this.

            • bonzinia day ago
              Nope, there are subtle differences between Intel and AMD that make it a Bad Idea to fake the vendor.
              • ccgrega day ago
                There are? We aren't talking about feature bits, and the only known software that checks the vendor are Intel's math libraries.
                • bonzinia day ago
                  They are minor but enough to complicate things. For example Intel rejects the SYSCALL instruction outside 64-bit mode.
      • IshKebab2 days ago
        You can just use QEMU. It has RVA23 support and is probably still faster and easier than using actual machines.
        • emmatyping2 days ago
          That's plausible. The bigger constraint to defaulting to RVA23 is that users are running on, and building all of their wheels targetting, RV64GC. So unless our users adopt RVA23, it would be unwise to switch.
        • LeFantome2 days ago
          Great point. But QEMU is no longer faster than real hardware for the latest RISC-V chips.

          You are right though that QEMU is probably faster than anything only capable of RV64GC (lacking RVA23). So QEMU would probably be a great option for the CPython team.

      • jubilanti2 days ago
        So is 32bit out of scope? ESP32 devices are increasingly RISC-V but 32bit.
        • 6SixTy2 days ago
          32 bit RISC-V is pretty much limited to microcontrollers. There's no serious projects to create a Linux capable RV32 machine. Only FPGA soft cores and QEMU.

          There is micropython, but just from the description, it's a separate project entirely with the same syntax, etc.

          • jubilanti2 days ago
            > 32 bit RISC-V is pretty much limited to microcontrollers

            Hence me explicitly talking about ESP32. I was asking about microcontrollers. I know about micropython. I was asking about CPython.

            • gavinsyancey2 days ago
              CPython needs you to also be running an operating system. And while it might be theoretically possible to get a NoMMU Linux running on an ESP32, that's generally not very useful for practical applications compared to micropython or something that's actually designed for a microcontroller.
      • 6SixTy2 days ago
        [dead]
    • camel-cdr2 days ago
      I wonder how much this matters for python. As long as the important dependencies like numpy runtime dispatch RVV, it should probably be fine.

      Zba would probably give a small boost. Zbb gives a substantial boost to perf for applications that use clz/popc heavily, but I don't think that would apply to python.

    • shash2 days ago
      It’s not like GC isn’t a massive part of RVA23 - those are the basic instructions that handle 80-90% of all uses (including most of what CPython needs).

      I’m sure one could do some optimizations on RVA23, but is it really worth it?

      • hajile2 days ago
        Vectors are pretty big for speeding up stuff like string comparisons.

        Bit manipulation offers up to almost 10% advantage.

        Zicond allows branchless code which represents significant speedups.

        There’s also serious gains to be had from crypto support.

        I’d guess the rest aren’t as important to Python, but those are quite important.

      • LeFantome2 days ago
        Vector extensions are the biggest gap. That is going to make a pretty big difference for some stuff.
    • londons_explore2 days ago
      RISC-V fragmentation bites again...
      • Karliss2 days ago
        People bring this up to every RISC-V discussion but the same could be said for ARM or x86. For which ARM instruction set is built? Does this ARM cpu support integer division instructions, does support arm and thumb instruction encoding, only arm, only thumb, does it have a floating point unit, does it have neon, does it have MMU. Those are still relevant questions for ARM cores. On x86 situation is even crazier https://gcc.gnu.org/onlinedocs/gcc/x86-Options.html . Some of the more recent CPUs list ~60 optional features. Even if you look just at generic common profiles you have i386, i486, i586, i686, x86-64, x86-64-v2, x86-64-v3, x86-64-v4. Just a single family of vector instructions has 6 different versions for example: SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2. I am not even going to try counting all the variations and optional instructions of AVX512.

        On one hand this is an important topic, especially in contexts like which X86-64 profile are the software in Linux distro official repositories targeting.

        At the same time no one is bothered by 20 cent ARM mcu not having instructions for atomic memory access, supervisor, SIMD or even floating point.

        So if anything RISC-V instruction set optional feature sets are probably better structured and less fragmented (for now) than the current situation with ARM and x86.

        • 2 days ago
          undefined
        • tubs2 days ago
          For AP cores where Python actually runs it’s just “arm8” and pick your incremental version on top.
          • mort962 days ago
            If you'd limit yourself to cores implementing the Application profile of ARM (Armv8-A etc), you'd do the same and limit yourself to cores implementing the Application profile of RISC-V (RVA23 etc). In that case, you can assume vector instructions and everything else.

            If you don't, you get the exact same kind of question with ARM as with RISC-V. Do you use NEON or with SVE? Or do you conservatively compile without vector instructions at all even though it could possibly result in speed-ups for some loops?

          • sweetjuly2 days ago
            I don't think you're giving ARM credit for the ever growing pile of features which are always optional or optional only on some versions of the ISA.

            For example, can you use FEAT_CSSC to improve code size and performance? Well, if the target is <v8.7, the answer is no. If it's v8.7 or v8.8, well, then it depends on whether your specific implementation has it. Only after v8.9 is it mandatory.

            Targeting armv8a is the moral equivalent of targeting RV64GC insofar as it will run on any application class core. Targeting that, however, leaves a fair bit of useful ISA enhancements on the table, and so you tend not to want to do that if you can get away with it.

          • ac292 days ago
            Micropython runs on tons of stuff and while it isnt capital-P Python, its close enough for doing a wide variety of embedded work without learning a new language/libraries/etc.
          • shash2 days ago
            For RISC-V that would functionally be RV64GC then. And you go incrementally from there as required.
      • orangeboats2 days ago
        The same problem exists for x86. Is $program built for x86-64 with SSE2? AVX2? AVX512? (I chose those three because they are programmer-visible. Programmers have to use intrinsics to exploit those ISA extensions effectively.)

        For RISC-V the questions to ask are similar: Is this built for RVA20? Or RVA23? (The big feature of RVA23 is the Vector extension, again something that is programmer-visible)

        Embedded RISC-V programmers will have to ask a lot more questions. But for most programmers the whole fragmentation thing is simply a giant meme repeated ad nauseam.

        • mort962 days ago
          Intel has done such a good job keeping AVX512 support away from reaching ubiquitous adoption, it's insane. There are so many useful instructions in AVX512 which are just missing from AVX/AVX2 that you can't assume exist, even on modern CPUs, because Intel can't get their shit together.

          The core problem was tying instructions to bit width. But I'm actually surprised that they didn't add AVX512 support through double pumped 256-bit operations like AMD did for a while.

      • LeFantome2 days ago
        > RISC-V fragmentation bites again...

        Wrong.

        What fragmentation? Find me a 64 bit RISC-V chip you want to run Python on that will not execute an RV64GC binary.

        The issue is not fragmentation but ecosystem maturity. The exact same situation exists for all chips.

        In most x86-64 Linux distros, CPython will be compiled to target x86-64v2. This means it will not use, for example, any of the latest vector math extensions that the x86-64v4 chip you are probably running is capable of.

        The reason distros target the older profile is that not everybody has the latest hardware. There is no difference conceptually between x86-64 and RISC-V.

        The difference with RISC-V is that RV64GC is more primitive than x86-64v2 and so it hurts more. And fewer people have RVA23 capable chips than have x86-64v4 chips. RVA23 is the RISC-V profile that describes essentially equivalent capabilities to x86-64v4.

        But there is less RISC-V hardware in the wild in general. So, there is less legacy baggage to carry forward. RISC-V will go mainstream on a more modern profile than other chips.

        Ubuntu 26.04 and newer require RVA23 support. And all new application class RISC-V processors will support RVA23. It will not be long before this is the standard RISC-V profile. It will probably happen before the x86-64 world standardizes on x86-64v4 (or even v3). So your “fragmentation” will be a bigger deal on x86-64 than on RISC-V.

        But, today, projects like CPython are still using RV64GC level hardware. So, that is what they target.

        Most of us do not have any desktop or server class RISC-V hardware. When we do, it will be capable of RVA23. And CPython will probably target that profile. Fragmentation has nothing to do with it.

        Check back in 2 years.

    • whateverboat2 days ago
      One could always build libraries which people can use if they need the more high-performance cores. There is not much in the CPython core that will benefit though.
  • throwaway815232 days ago
    CPython is written in C, did running it on Risc-V take more than a recompilation? Were there any surprises? Yes of course it needs testing and RISC-V in the CI stack, but I'd expect fairly smooth sailing.
    • emmatyping2 days ago
      In short, we haven't found many bugs, but it also wasn't just recompile on a new platform.

      We've seen test failures like https://github.com/python/cpython/issues/151040

      And perf support needs to be tested and merged https://github.com/python/cpython/issues/121201

      Overall though, fairly smooth sailing as you say.

      The reason RISC-V wasn't already supported is a mix of lacking hardware access for build bots and committers willing to pledge time to support it.

    • shash2 days ago
      We ran it 4 years ago (including numpy) and it wasn’t a massive uphill climb or anything. It’s gotten a little easier since then if anything.
    • tyingq2 days ago
      There is a Configure type subsystem, so you'll see stuff like this: https://github.com/python/cpython/pull/156277/changes#diff-4...
    • tlk-228152 days ago
      We ran python-3.14 on RISC-V before switching to C++ only. It compiled without any errors and all tests passed.

      I don't understand the significance of this announcement in the submission.

    • rzulasf2 days ago
      [flagged]
  • yyyk2 days ago
    Odd they still have i686-pc-windows-msvc as Tier 1 *. Even Microsoft doesn't have any supported 32bit Windows versions anymore, and C extension modules likely follow Linux (where Python doesn't have any no supported i686 triplets in any tier). It would be more modern to demote its Tier and promote aarch64 Windows or wasm32 instead to Tier 1.

    * https://peps.python.org/pep-0011/#tier-1

    • woodruffw2 days ago
      Python's tiering has to do with testability and availability thereof, not modernness. In the case of 32-bit Windows, the reason it's still testable is because Windows still ships a 32-bit userspace, even if Windows itself only supports x86-64.

      (From personal experience, testing Windows aarch64 is a massive PITA, even on GitHub Actions, which all common sense would indicate should have the best aarch64 Windows CI runner story.)

      • yyyk13 hours ago
        That explains Tier-2 vs Tier-3. Not Tier-1 (where i686-windows is) vs Tier-2. Demanding every commit pass CI is a project decision.
  • yjftsjthsd-h3 days ago
    > RISC-V is now officially supported by CPython as a tier 3 platform!

    That's significant, but tier 3 is still a caveat. Still allowed to break without blocking anything or being fixed as a priority.

    • jmalicki3 days ago
      Sure, but I had to look:

      Tier1: Windows x64/i686, Linux x64/ARM gcc, Darwin/ARM

      Tier2: Linux x64/ARM w/ clang, Windows ARM, WASM, Darwin/x64

      Tier3 is a pretty low support level, but tiers 1 and 2 is a pretty short list of major commercial platforms. Also even for developers to fix, availability of e.g. RiscV machines in the cloud to reproduce and fix on is still somewhat limited.

    • phire2 days ago
      Needs to start somewhere.

      Looks like the most important step towards tier two is mostly about proving the CI infrastructure is reliable (which takes time at tier 3), and have at least two core developers committed to fixing any issues (within 24 hours)

    • digkls2 days ago
      RISC-V is one of those experimental architectures that hardly anyone is actually using, isn't it?

      Tier 3, or no support at all, seems an appropriate designation.

      • boredatoms2 days ago
        Not much on user facing OS, but billions of small controllers
        • yjftsjthsd-h2 days ago
          I don't think CPython targets those, though; that seems more like a micropython thing?
          • 2 days ago
            undefined
  • Qem2 days ago
    Did they already test how the proposed jit fares on RISC-V?
  • saint-evana day ago
    We got RISC-V support before an official 3.14t docker image.
  • greatgib2 days ago
    For quite some times I'm wondering how I could invest in RISC, or RISC related manufacturer but it looks like all companies are private.
    • 2 days ago
      undefined
    • boredatoms2 days ago
      Check out Hiive and make a bid if you want Sifive stock

      also Andes is public

      • greatgiba day ago
        Sadly I think that Hiive is restricted to US based investors.
  • vrightera day ago
    when I designed my own simple risc-v processor with just rv32i, i just compiled lua. Hassle free
  • jartan20022 days ago
    [flagged]
  • fenestella2 days ago
    [dead]
  • scam-alt-human2 days ago
    [flagged]
    • zopppo2 days ago
      How is Python a dead language due to ML when it's the lingua franca of AI/ML between pytorch, pandas, numpy, langchain, litellm, vLLM, and a whole bunch of other libraries?
  • gagan20202 days ago
    Can we do something about CPython Global Interpreter Lock (GIL)?