in psychology, there is, or at least has been, a tendency to accept things as true if a single study showed it, thus causing the replication crisis, duh.

this runs contrary to what other branches of science do, which is to wait until a bunch of studies have been carried out and peer-reviewed, and cumulate the data from these studies to produce meta-analyses:

> A meta-analysis is a statistical analysis that combines the results of multiple scientific studies. Meta-analysis can be performed when there are multiple scientific studies addressing the same question, with each individual study reporting measurements that are expected to have some degree of error. The aim then is to use approaches from statistics to derive a pooled estimate closest to the unknown common truth based on how this error is perceived.

you're basically trying to gather as much data from as many different studies as possible in order to reach a conclusion, instead of relying on a single study. ideally, scientific consensus should be based on such analyses.

most of the reporting on scientific study results in the media are from individual studies, not meta-analyses. they might have reached correct conclusions, but they might also be flawed.
thus, in branches of science where the studies are few and the sample sizes are small, there are going to be more wrong theories.
when it comes to branches of science, my feeling is that they rank roughly like this in terms of how hard (scientific) they actually are:

1. physics
2. medicine
3. psychiatry
4. psychology
5. social anthropology
6. sociology
7. gender studies
i've got people who follow me who are skeptical of all science because they don't understand meta-analysis nor the concept of hard versus soft sciences.
@thor I would personally advocate for the separation of physical and social sciences. They don't have much in common.
@SuperDicq if scientists in the softer sciences were more rigorous and data based, they would be less soft, but there just doesn't seem to be a culture for it.

@thor @SuperDicq
Social studies is not a field where obtaining true absolute data is easy unlike compare physics or chemistry.

@mur2501 @SuperDicq if this is the case, it's hardly a science at all, and has more in common with fields such as history or literature.

@thor @SuperDicq
In the sense of the process of analysis, data gathering and everything it is a science, but due to the lack of determining which source of data are corrupted and biased it becomes less accurate in terms of it's results

@mur2501 @SuperDicq i'd argue that the more the data needs to be interpreted to reach a conclusion, the more assumptions you must make about it, the less scientific it is.
Follow

@thor @SuperDicq
Taking many assumptions isn't unscientific, but using the results of that study and applying it to the general space without those assumptions is unscientific.

@mur2501 @SuperDicq this is true, but makes said study of more limited use.

@thor @mur2501 I don’t necessarily say that the use limited.

In social sciences like psychology there’s no better alternative than to make some assumptions because a lot of this can not be objectively proven in any way, but we do need some kind consensus because otherwise there would be no mental healthcare.

@GNUxeava @SuperDicq @mur2501 the more assumptions, the more constraints, the less generally applicable the study's conclusion, thus more limited.
@GNUxeava @SuperDicq @mur2501 science with a limited area of application is still science. it's just less useful.
Sign in to participate in the conversation
CleverLibre Social

CleverLibre Social is an inclusive social instance for open discussion, learning, and community.
All cultures welcome.
Hate speech and harassment strictly forbidden.