6 ms·

CudaSharp - Making C# run on the GPU

67 points by codereflection 13y ago

IanDrake 13y ago
If you're looking for something more immediately usable, try Cudafy.NET.
- j_s 13y ago
  lgpl - http://cudafy.codeplex.com/ http://cudafy.codeplex.com/ commercial - http://www.hybriddsp.com/Downloads.aspx http://www.hybriddsp.com/Downloads.aspx
VikingCoder 13y ago
For the curious, you could also check out Brahma, which translates LINQ to GPU. http://www.infoq.com/news/2010/05/Brahma http://www.infoq.com/news/2010/05/Brahma
- voltagex_ 13y ago
  or http://brahma.codeplex.com/SourceControl/latest http://brahma.codeplex.com/SourceControl/latest
Nilzor 13y ago
What practical applications would this have?
- _random_ 13y ago
  Using a high-level mainstream language to increase math calculations performance in an affordable way.
blt 13y ago
This is cool, but I wonder if compiled C# code will be too branchy to run fast on the GPU. So many bounds checks, exceptions, ...
- khyperia 13y ago
  Right now, not a lot of C# code can actually be compiled to run on the GPU. It's using a custom JIT compiler that I made, I've only spent about two days working on it so far, so naturally it's nowhere near feature-complete. Examples of things that it doesn't support are exceptions, dynamic allocation of memory, the like. Essentially, you are writing CUDA kernel code, but in C# instead. Whatever CUDA C can't do, you can't do (even if normal C# can) - for example, exceptions aren't in CUDA C, so "throw" (and try/catch) won't ever be supported. Actually on topic to your point, it's being compiled through LLVM, which is a very awesome compiler backend that does a bunch of optimizations on code.
- taspeotis 13y ago
  I don't think that the C# compiler does much optimization, so the MSIL won't be that optimized (therefore if you were literally translating that your output would be not that optimized) but you can always do what the CLR does and take advantage of the platform and/or guarantees in the code. For example http://blogs.msdn.com/b/oldnewthing/archive/2013/08/09/10440495.aspx http://blogs.msdn.com/b/oldnewthing/archive/2013/08/09/10440...
khyperia 13y ago
Oh, wow, author of that library here, thanks for posting this! I originally intended it to be a little fun experiment, but if there's real interest, then I can certainly clean it up and make it usable. Last night I changed it to not depend on llc.exe and instead use the llvm api (had to compile llvm-3.4... that was not fun), which was one of the biggest roadblocks I foresaw with respect to redistributability.
- codereflection 13y ago
  Hey, hope you don't mind that I posted it here. I came across this on The Morning Brew, and thought that a broader audience might appreciate your efforts.
  - khyperia 13y ago
    I certainly don't mind! I've actually never had someone re-post a project of mine, quite the surprise I got just now! I've never heard of The Morning Brew, what exactly is it?
    - mkchandler 13y ago
      It's a daily blog post that rounds up some of the more popular .NET related posts around the web: http://blog.cwa.me.uk/ http://blog.cwa.me.uk/
      - sn0v 13y ago
        Funny they'd call it that when they're not covering the rival (Java) :P
bluej4ack 13y ago
What advantages does it have over http://research.microsoft.com/en-us/projects/Accelerator/ http://research.microsoft.com/en-us/projects/Accelerator/ ?
- khyperia 13y ago
  Not sure. It's a quick research project, created by a bored high school student (me). Edit: Although judging by the reaction it's getting, I very well might try and release it with a stable version and really make it shine. I haven't looked into Accelerator that much, so I'm not entirely sure how to compare them. Please note, however, that the CudaSharp project was created no more than four days ago, so doing a direct featureset comparison might give some skewed results. A quick skim of that link makes it look like Accelerator is using DirectX for its GPU work. CudaSharp is using CUDA (via LLVM), so there's one major difference. (I plan on eventually porting it to OpenCL as well - but there's not much documentation on the OpenCL LLVM backend, I'm not sure if it even exists)
  - bluej4ack 13y ago
    My understanding is that it supports both, but I may be mistaken
m_mueller 13y ago
There's also a commercial product called Quant Alea (targeted at the financial market) that gives you CUDA on F#, including live Excel adaptors.
- profquail 13y ago
  In fact, there are several options for running F# code on a GPU, some commercial and some free/open-source: http://fsharp.org/use/gpu/ http://fsharp.org/use/gpu/
_random_ 13y ago
"Calling the CudaSharp.Translate method reads the CIL, translates to LLVM IR" Does it open a door to transpiling C# to asm.js (sorry for off-topic)?
- khyperia 13y ago
  I've never heard of asm.js before, but doing a bit of googling looks like it's sort of like an LLVM backend. Theoretically, yes. However, that translation from CIL to LLVM IR isn't the easiest thing in the world. Right now I'm only supporting a subset of the instructions that roughly correspond to the things available on the GPU, and adding support for the entire C# language is an extreme task. There's a reason there's a huge team at MS dedicated to writing the JIT for .net. But yes, it would be possible, it would just be a lot of work and probably wouldn't support much of C#.
- deleted 13y ago
  [deleted]
aashishkoirala 13y ago
I like what you've done. I hope to see you take it all the way through. Nice job!

If you're looking for something more immediately usable, try Cudafy.NET.

j_s 13y ago
lgpl - http://cudafy.codeplex.com/ http://cudafy.codeplex.com/ commercial - http://www.hybriddsp.com/Downloads.aspx http://www.hybriddsp.com/Downloads.aspx

For the curious, you could also check out Brahma, which translates LINQ to GPU. http://www.infoq.com/news/2010/05/Brahma http://www.infoq.com/news/2010/05/Brahma

voltagex_ 13y ago
or http://brahma.codeplex.com/SourceControl/latest http://brahma.codeplex.com/SourceControl/latest

Nilzor 13y ago

What practical applications would this have?

_random_ 13y ago
Using a high-level mainstream language to increase math calculations performance in an affordable way.

blt 13y ago

This is cool, but I wonder if compiled C# code will be too branchy to run fast on the GPU. So many bounds checks, exceptions, ...

khyperia 13y ago
Right now, not a lot of C# code can actually be compiled to run on the GPU. It's using a custom JIT compiler that I made, I've only spent about two days working on it so far, so naturally it's nowhere near feature-complete. Examples of things that it doesn't support are exceptions, dynamic allocation of memory, the like. Essentially, you are writing CUDA kernel code, but in C# instead. Whatever CUDA C can't do, you can't do (even if normal C# can) - for example, exceptions aren't in CUDA C, so "throw" (and try/catch) won't ever be supported. Actually on topic to your point, it's being compiled through LLVM, which is a very awesome compiler backend that does a bunch of optimizations on code.
taspeotis 13y ago
I don't think that the C# compiler does much optimization, so the MSIL won't be that optimized (therefore if you were literally translating that your output would be not that optimized) but you can always do what the CLR does and take advantage of the platform and/or guarantees in the code. For example http://blogs.msdn.com/b/oldnewthing/archive/2013/08/09/10440495.aspx http://blogs.msdn.com/b/oldnewthing/archive/2013/08/09/10440...

khyperia 13y ago

Oh, wow, author of that library here, thanks for posting this! I originally intended it to be a little fun experiment, but if there's real interest, then I can certainly clean it up and make it usable. Last night I changed it to not depend on llc.exe and instead use the llvm api (had to compile llvm-3.4... that was not fun), which was one of the biggest roadblocks I foresaw with respect to redistributability.

codereflection 13y ago
Hey, hope you don't mind that I posted it here. I came across this on The Morning Brew, and thought that a broader audience might appreciate your efforts.
- khyperia 13y ago
  I certainly don't mind! I've actually never had someone re-post a project of mine, quite the surprise I got just now! I've never heard of The Morning Brew, what exactly is it?
  - mkchandler 13y ago
    It's a daily blog post that rounds up some of the more popular .NET related posts around the web: http://blog.cwa.me.uk/ http://blog.cwa.me.uk/
    - sn0v 13y ago
      Funny they'd call it that when they're not covering the rival (Java) :P

bluej4ack 13y ago

What advantages does it have over http://research.microsoft.com/en-us/projects/Accelerator/ http://research.microsoft.com/en-us/projects/Accelerator/ ?

khyperia 13y ago
Not sure. It's a quick research project, created by a bored high school student (me). Edit: Although judging by the reaction it's getting, I very well might try and release it with a stable version and really make it shine. I haven't looked into Accelerator that much, so I'm not entirely sure how to compare them. Please note, however, that the CudaSharp project was created no more than four days ago, so doing a direct featureset comparison might give some skewed results. A quick skim of that link makes it look like Accelerator is using DirectX for its GPU work. CudaSharp is using CUDA (via LLVM), so there's one major difference. (I plan on eventually porting it to OpenCL as well - but there's not much documentation on the OpenCL LLVM backend, I'm not sure if it even exists)
- bluej4ack 13y ago
  My understanding is that it supports both, but I may be mistaken

m_mueller 13y ago

There's also a commercial product called Quant Alea (targeted at the financial market) that gives you CUDA on F#, including live Excel adaptors.

profquail 13y ago
In fact, there are several options for running F# code on a GPU, some commercial and some free/open-source: http://fsharp.org/use/gpu/ http://fsharp.org/use/gpu/

_random_ 13y ago

"Calling the CudaSharp.Translate method reads the CIL, translates to LLVM IR" Does it open a door to transpiling C# to asm.js (sorry for off-topic)?

khyperia 13y ago
I've never heard of asm.js before, but doing a bit of googling looks like it's sort of like an LLVM backend. Theoretically, yes. However, that translation from CIL to LLVM IR isn't the easiest thing in the world. Right now I'm only supporting a subset of the instructions that roughly correspond to the things available on the GPU, and adding support for the entire C# language is an extreme task. There's a reason there's a huge team at MS dedicated to writing the JIT for .net. But yes, it would be possible, it would just be a lot of work and probably wouldn't support much of C#.
deleted 13y ago
[deleted]

aashishkoirala 13y ago

I like what you've done. I hope to see you take it all the way through. Nice job!