stonehenge-reddit-challenge

•15.58 MB

•2d ago

My entry to the stonehenge reddit challenge proposed by @aligato. Thanks for the source material: https://www.reddit.com/r/GaussianSplatting/comments/1tyeel5/stonehenge_splatoff_same_video_who_gets_the/ Heres my run at the splat-off. Trained this completely on-device with RadianceKit (my Mac app), no colmap, no cuda, no cloud. The numbers: - 400 sharpest frames from the shared video at 2048px - Camera poses: 6 min 43 s (apple photogrammetry backend, 400/400 cameras registered, 166k points) - Training: 7 min 45 s, 20k iterations at ~43 it/s - Total from frames to finished ply: about 15 minutes 871k splats, SH degree 3. Hardware was an m3 ultra so ur mileage may vary on smaller machines, but the whole pipeline runs on any apple silicon mac. Interesting bit I learned during this: I also did a 2 million splat version that scores better on psnr but actually looks worse, way more of that grainy confetti in the grass and on the stones. Less splats trained well beat the big budget visually, the metric just doesnt see it. So this entry is deliberately the smaller one because it looks more natural. Small note, the hybrid trainer that produced this isnt in the app store build yet, its coming with the next RadianceKit update. Whats live today gets close but this exact recipe is the new one. The source being a 1440p youtube re-encode definately eats some fine texture detail on the stones, curious how the other entries deal with that.

Suggested

6 Comments

kosso1 day ago

@bkinder Thanks!

bkindler1 day ago

@kosso Acknowledged. ;)

bkindler1 day ago

@kosso Wow, thank you so much. This is extremely helpful. How can I send you the unlock code?

kosso1 day ago

@bkinder Here's a 2Gb zip download containing the source video and SRT file which I used to create this splat. https://superspl.at/scene/77dd0698 https://kosso.co.uk/klipz/DJI-Neo2-MP4SRT-Pensford-Viaduct.zip

bkindler1 day ago

@kosso Thank you very much - that would be great. I'm willing to give aut a promo code for valuable feedback. To be honest. I put the srd idea on my future features list the second I saw it on Reddit. 😅

kosso1 day ago

Very nice. I see you're the developer of RadianceKit. Nice. I'm going to give that a try this weekend. (I'm mostly on macOS too). I've been building a simple iOS app which replicates what the DJI drones can do, with generating .SRT files with MP4 video for splat generation. (It can also do photos, and generate sparse Colmaps) Currently I have to send all files over to my Windows machine and back to get the job done. Do you think RadianceKit could one day utilise MP4+.SRT files? That would be very cool. (Let me know if you ever need any sample videos and data from a drone) Cheers!

Loading comments...