The have a nice comparison to T-HMR, but I did not see a comparison to OpenPose. If that exists somewhere, please give me a pointer.
[edit]
OK, so I read a little further. Answered my own questions a bit, so here is what I found:
VIBE produces 3D pose from 2D video. OpenPose needs stereo video for 3D pose estimation. OpenPose can produce 2D joint position tracking from 2D video. OpenPose 2D annotations were used to automate labeling input data sets for training VIBE.
So, OpenPose: 2D video -> 2D pose estimate. VIBE 2D video -> 3D pose estimate.
You seem to point out the restrictive license (for non-commercial research purposes only) as if it's a negative, when I don't believe that it is.
Why should companies be allowed to profit from a proprietary wrapper around open-source software built on top of decades of open-access research? Open research should stay open.
The main downside of any license that is restrictive is that it creates legal boundaries where no technical limitations exist, which on top of preventing the kinds of things you don’t want, can very well prevent totally desirable things as well (prime example is GPL compatibility with ZFS and Linux.)
I am not really too concerned personally but suggesting a restrictive license has no downsides or there is not a valid viewpoint where a restrictive license is a negative doesn’t make sense, it’s just not true.
That is not true, their license allows almost everything other than commercial usage. Quote from their licence: "...To use the Model & Software for the sole purpose of performing non-commercial, scientific research, non-commercial education, or non-commercial artistic projects; Any other use, in particular any use for commercial purposes, is prohibited. This includes, without limitation,
incorporation in a commercial product, use in a commercial service, or production of other artifacts for
commercial purposes. The Model & Software may not be reproduced, modified and/or made available in any form to
any third party without Max-Planck’s prior written permission."
> You seem to point out the restrictive license (for non-commercial research purposes only) as if it's a negative,
Two word statement of fact: "Restrictive license." From those two words, you create a straw man.
I have said before, here on HN and other places, that people should choose a license the way they choose a screwdriver, not the way they choose a religion. The license must fit the project goal.
I point out the restrictive license in part because it is not one of the usual licenses that often accompanies source releases. A noteworthy oddity. An oddity that will cost money to understand, if need be.
I point out the restrictive license in part to make people aware that they need to investigate before deciding to invest a lot of time evaluating this package. Simply a courtesy.
As you point out, the license may or may not be a problem depending on the use case. I know of several entities that might be interested in taking a commercial license. I know of several entities that would have already stopped reading because the license does not fit their agenda.
Indeed. Or other sports applications. I have a friend that is an elite-level track coach. She has an iPad app that helps analyze running form from video. This tech could be used to improve apps like that.
My own little pet thought experiment for years has been an app that would track violin or 'cello bow motion to provide feedback to students on bowing technique. I am sure there are many similar applications.
occlusion is an impassable barrier in this case it seems. For some motions it can work, but if you can't see some limbs behind the back etc. there is not much that can be done regardless of the estimation
16 comments
[ 4.2 ms ] story [ 43.8 ms ] threadThe have a nice comparison to T-HMR, but I did not see a comparison to OpenPose. If that exists somewhere, please give me a pointer.
[edit] OK, so I read a little further. Answered my own questions a bit, so here is what I found:
VIBE produces 3D pose from 2D video. OpenPose needs stereo video for 3D pose estimation. OpenPose can produce 2D joint position tracking from 2D video. OpenPose 2D annotations were used to automate labeling input data sets for training VIBE.
So, OpenPose: 2D video -> 2D pose estimate. VIBE 2D video -> 3D pose estimate.
Why should companies be allowed to profit from a proprietary wrapper around open-source software built on top of decades of open-access research? Open research should stay open.
I am not really too concerned personally but suggesting a restrictive license has no downsides or there is not a valid viewpoint where a restrictive license is a negative doesn’t make sense, it’s just not true.
Nope. The license allows precisely three uses: research, education, and non-commercial art. That's it.
In other words, even use in FOSS-compliant plugin's (e.g. for Blender) isn't allowed.
"Open research should stay open."
How does someone building a product on it suddenly make it "not open?"
Two word statement of fact: "Restrictive license." From those two words, you create a straw man.
I have said before, here on HN and other places, that people should choose a license the way they choose a screwdriver, not the way they choose a religion. The license must fit the project goal.
I point out the restrictive license in part because it is not one of the usual licenses that often accompanies source releases. A noteworthy oddity. An oddity that will cost money to understand, if need be.
I point out the restrictive license in part to make people aware that they need to investigate before deciding to invest a lot of time evaluating this package. Simply a courtesy.
As you point out, the license may or may not be a problem depending on the use case. I know of several entities that might be interested in taking a commercial license. I know of several entities that would have already stopped reading because the license does not fit their agenda.
My own little pet thought experiment for years has been an app that would track violin or 'cello bow motion to provide feedback to students on bowing technique. I am sure there are many similar applications.