A timer which tracks your moves using only the camera - Feedback Wanted

[Damian P]

Hi all,

This is something that I've been working on for years, and I honestly didn't think I'd get to this point, but here we are.

Cube-Vision is an app that records your solves, runs a vision algorithm to reconstruct the moves, and then compiles your stats.
You can use any cube with a normal color scheme, no bluetooth connection required.

A short demo

iOS: https://apps.apple.com/us/app/cube-vision/id6794732933

Android: Currently in closed testing. Email me at [email protected] asking for access and I can add you to the closed test.
(Android version does not have the algorithm trainer yet)

Current Features:

• Move by move reconstruction of 3x3 solves
• CFOP stage segmentation with per stage times, move counts, and TPS, both average and for each solve
• Recognition time for each stage
• Solve replay with the recorded timings of each move
• Average times for each OLL and PLL case
• Hand tracking for automatic starting and stopping of the timer*
• Solve export to share reconstruction + video with friends

The app is completely free, no account required. All processing is done on device so the app can work offline. Videos never leave your device unless you choose to share them.

*The hand tracking for the timer start/stop is heavily inspired by swiftcuber.com. If you're not interested in solve reconstruction and just want to start / stop the timer by putting your hands down you should use swiftcuber instead.

Future Features (I'd love to hear other recommendations as well):

• Lower extraction times (app update should be out within a week, already works in testing, should be easily faster than real time so solves won't get backed up)
  • This should allow for an algorithm trainer in the near future as well
• Stage breakdowns for Roux (I might have to actually learn Roux for this one)
• Deeper analysis for Cross + F2L
• QoL changes: streamline UI, add light mode, etc.

Something not well explained by the app, the top and front of the cube both need to be visible during the solve (one side is not enough information) and the left and right sides should not be visible (they make it unclear which side is the front). If you can angle the camera down toward the cube that is best, but propping it so the phone is vertical is also fine as long as the top of the cube is still visible.

If you could share with me your feedback or any issues that you run into I'd really appreciate it.

 

[Damian P]

New update is now out, enabling real time tracking. I'd really appreciate any feedback on the new algorithm trainer in particular. I'd like to know if it is intuitive to use, and what changes you'd like to see to it to make it more useful. Any other feedback is also welcome.

 

[Nikcubing13]

Well I would love to give u some feedback but I'm on mobile

 

[iguana]

Hi all,

This is something that I've been working on for years, and I honestly didn't think I'd get to this point, but here we are.

Cube-Vision is an app that records your solves, runs a vision algorithm to reconstruct the moves, and then compiles your stats.
You can use any cube with a normal color scheme, no bluetooth connection required.

A short demo

iOS: https://apps.apple.com/us/app/cube-vision/id6794732933

Android: Unfortunately not available yet, the play store review process is a pain.

Current Features:

• Move by move reconstruction of 3x3 solves
• CFOP stage segmentation with per stage times, move counts, and TPS, both average and for each solve
• Recognition time for each stage
• Solve replay with the recorded timings of each move
• Average times for each OLL and PLL case
• Hand tracking for automatic starting and stopping of the timer*
• Solve export to share reconstruction + video with friends

The app is completely free, no account required. All processing is done on device so the app can work offline. Videos never leave your device unless you choose to share them.

*The hand tracking for the timer start/stop is heavily inspired by swiftcuber.com. If you're not interested in solve reconstruction and just want to start / stop the timer by putting your hands down you should use swiftcuber instead.

Future Features (I'd love to hear other recommendations as well):

• Lower extraction times (app update should be out within a week, already works in testing, should be easily faster than real time so solves won't get backed up)
  • This should allow for an algorithm trainer in the near future as well
• Stage breakdowns for Roux (I might have to actually learn Roux for this one)
• Deeper analysis for Cross + F2L
• QoL changes: streamline UI, add light mode, etc.

Something not well explained by the app, the top and front of the cube both need to be visible during the solve (one side is not enough information) and the left and right sides should not be visible (they make it unclear which side is the front). If you can angle the camera down toward the cube that is best, but propping it so the phone is vertical is also fine as long as the top of the cube is still visible.

If you could share with me your feedback or any issues that you run into I'd really appreciate it.

This sounds awesome, but please could I have a link?

 

[Nikcubing13]

This sounds awesome, but please could I have a link?

I think it is an app not a website

 

[iguana]

I think it is an app not a website

How do I get it then?

 

[Damian P]

How do I get it then?

There's a link to the app store in the original post, if you have an iPhone you should be able to download it there. I should have the Android version within a week, maybe two.

 

[iguana]

There's a link to the app store in the original post, if you have an iPhone you should be able to download it there. I should have the Android version within a week, maybe two.

Is it possible to access it on a laptop?

 

[jvqtil]

Hi all,

This is something that I've been working on for years, and I honestly didn't think I'd get to this point, but here we are.

Cube-Vision is an app that records your solves, runs a vision algorithm to reconstruct the moves, and then compiles your stats.
You can use any cube with a normal color scheme, no bluetooth connection required.

A short demo

iOS: https://apps.apple.com/us/app/cube-vision/id6794732933

Android: Unfortunately not available yet, the play store review process is a pain.

Current Features:

• Move by move reconstruction of 3x3 solves
• CFOP stage segmentation with per stage times, move counts, and TPS, both average and for each solve
• Recognition time for each stage
• Solve replay with the recorded timings of each move
• Average times for each OLL and PLL case
• Hand tracking for automatic starting and stopping of the timer*
• Solve export to share reconstruction + video with friends

The app is completely free, no account required. All processing is done on device so the app can work offline. Videos never leave your device unless you choose to share them.

*The hand tracking for the timer start/stop is heavily inspired by swiftcuber.com. If you're not interested in solve reconstruction and just want to start / stop the timer by putting your hands down you should use swiftcuber instead.

Future Features (I'd love to hear other recommendations as well):

• Lower extraction times (app update should be out within a week, already works in testing, should be easily faster than real time so solves won't get backed up)
  • This should allow for an algorithm trainer in the near future as well
• Stage breakdowns for Roux (I might have to actually learn Roux for this one)
• Deeper analysis for Cross + F2L
• QoL changes: streamline UI, add light mode, etc.

Something not well explained by the app, the top and front of the cube both need to be visible during the solve (one side is not enough information) and the left and right sides should not be visible (they make it unclear which side is the front). If you can angle the camera down toward the cube that is best, but propping it so the phone is vertical is also fine as long as the top of the cube is still visible.

If you could share with me your feedback or any issues that you run into I'd really appreciate it.

This sounds very good! While Google Play processes it, can we get an APK?

 

[Damian P]

Is it possible to access it on a laptop?

Not currently, my main concern is actually the laptop's camera not being high enough quality, but I'll do some testing and see if tracking is still reliable. I believe apple makes it really easy to release iPhone apps for Mac so that might be an option in the short term. Just out of curiosity, why do you prefer a laptop version to mobile?

 

[Damian P]

This sounds very good! While Google Play processes it, can we get an APK?

It's actually been approved for closed testing, you should be able to access it through this link: https://play.google.com/store/apps/details?id=com.damianpiech.cubevision.

The android version is a little behind the iOS version and doesn't have the algorithm trainer yet as real time tracking is significantly more difficult for android. You should still be able to reconstruct your solves and get stats with the android version.

 

[iguana]

Not currently, my main concern is actually the laptop's camera not being high enough quality, but I'll do some testing and see if tracking is still reliable. I believe apple makes it really easy to release iPhone apps for Mac so that might be an option in the short term. Just out of curiosity, why do you prefer a laptop version to mobile?

I have a laptop but not a mobile phone lol

 

[jvqtil]

It's actually been approved for closed testing, you should be able to access it through this link: https://play.google.com/store/apps/details?id=com.damianpiech.cubevision.

The android version is a little behind the iOS version and doesn't have the algorithm trainer yet as real time tracking is significantly more difficult for android. You should still be able to reconstruct your solves and get stats with the android version.

Not available for me

 

[Damian P]

Not available for me

Okay it looks like I need to manually approve you. My email is [email protected]. If you email me your email I can add you

 

[jvqtil]

Sent email

 

[Damian P]

Sent email

It looks like google needs to do a full app review whenever I add people to closed testing so there will be some delay (probably an hour or two) before the closed testing link works. I'll email you when the review is complete.