Justin,
Don't throw in the towel so soon. Let your forman know of your interest in learning the trade and the owner of the company if he/she is available. I'll be honest the first few years are not all fun if all your doing is digging or moving material around. Did you let them know why you were leaving? Are you in a training program?
If you enjoy it keep the faith and knocking on doors eventualy you will find the right place it just takes time.
Wirewiz