I gave up after about an hour as it was less than half done and I wanted to play something before bed. How does it do the indexing? Does it actually just read a part of each file and that would explain the really low amount of data moving between the two?
Yeah, it's just checking each file to see if it's an SFTS package, and if so, pulling a few bytes out of the header. The lengthy time isn't so much due to the quantity of data, simply the sheer amount of filesystem calls involved in examining every single file it comes across, since everything in the 0000000000000000 folder is (or should be) an STFS package. Though, now that I think about it, I could easily make it skip .data files (GOD chunks) so I'll probably add that in. It might shave off some time for people who have a shitload of GODs installed.
In the end though, 900 gigs of content simply might just be too much to index over SMB, off of a (probably) 5400 RPM drive. I won't give up on trying to optimize it, but there's probably a line in the sand that can't be crossed.
What I would like to see is an app (or existing integration) on PC or 360 or both: That manages duplicate profiles, eg; it allows you to copy a profile and manage two separate copies on two separate MU's .I and others are now doing this for a couple of reasons, it would be handy to have a simple app (or library) that allows you to pick which profile has been modified most recently (Perhaps even update and sync achievements) and/or duplicate a profile with ease. Some lefluffie functions on the 360 would be cool also, eg; un-corrupting, re-signing etc... The combination of portable x360.dll's and the 360's native libraries would, I imagine make it fairly easy to get off the ground. I would take a shot at it myself but no-one wants to sell XDK/dev-kits these days....
A basic PC app for profile management (Noob-friendly and robust) would be really cool! (FTP plugin, all the better!)
BTW Thanx for ur contribution with this management app! I'm looking forward to having the time to have a look at it ;-)
I'm sure Node21 would be keen to check this out! We talked about something like this a while ago, Do you think this would work with FSD 2.0 FTP also?
I haven't spoken to Node21 as I don't know him, but I hang out in the same IRC channels, so maybe we'll chat about it some day. The app does work with FSD 2.0, and the next version actually uses the FSD SMB sharing feature to do some cool shit.