You can run the test suite directly with run-tests. php. At minimum you'll need to specify the php executable that you wish to test against which you can do with the -p flag. Note that in order to run all tests correctly this should be an absolute path to the PHP executable.