There are some expenses you can't avoid, death certificates, crematorium costs etc., but the biggest expense, the funeral director, can be done away with altogether.
It may be frowned upon by other mourners, but I have asked my family to buy a d-i-y coffin and transport me to my final resting place in either a hired large estate car or my son in law's van.