Australians are less trusting of each other than they were five years ago, according to new data that also reveals shifting attitudes towards cultural diversity.