spiritually married

A term meaning your married in spirit or in the spirit of marriage.

Put bluntly you have taken your marriage vow, held a ceremony, gone before some kind of spiritual leader, etc. But not legally signed nor leagally bound to your "spouse.

This has been used by many people including:
#The lgbt community (prior prop 8)
#polyamorous
#bigamist
#Polygamist

# people not wanting or unable to commit in a legal binding way.