In the process of moving SVN repos over to TFS using the svn2tfs tool and I needed to get the first revision for a rather large repo. I found this command which returns me exactly what I needed. NOTE: This may take awhile if you have a lot of commits.
Fire up command prompt and type in:
svn log -r 1:HEAD --limit 1 svn://path/to/repo