Totally fine to run with Maven: lyo.testsuite/org.eclipse.lyo.testsuite.server/README.md at master · eclipse/lyo.testsuite · GitHub
No, the statement is that the test suite has not been updated since 2.1. But as Jad said, OSLC key focus is on interop, so you should be able to run 2.1 test suite against your 4.0.0.M1 server (formerly called provider). As Jad also said, beware that the test suite may not be written with a generic OSLC server in mind, but with the specific interest towards RTC and a few other early OSLC implementations.
Fantastic!
