ITO,
You must be a joy to work for.
It sounds like both your employees and you are uninformed (not a typo for uniformed).
The difference is that you are the one responsible for their safety training, and providing them with a safe working environment.
A whole crew can quit right in the middle of a job because of a safety issue, file for unemployment, and file complaints with OSHA. Where would that leave you? With an unfinished job, no help, OSHA visiting you, while the un-employees you're paying for are driving by laughing at you.
This is still a better case scenario than if somebody gets hurt.
The next time they whine for a safe ladder you should listen.
If you aren't worried about them, then at least worry about yourself.