Validity...or Trustworhiness?

It's been a crazy few days!  If it weren't for my brother coming down to hangout for a while I probably would have more in common with Nosferatu than a regular human being😹 (having been stuck indoors for most of the weekend).  When I started off this summer I gave myself a deadline to be done with my methods chapter by August 30th (chapter 3 of my proposal).  After reading...and reading...and reading...and re-reading (select articles form EDDE 802), I reached a point of saturation when it comes to methods.  I really wanted to read all of Lincoln & Guba's 1985 book called Naturalistic Inquiry during this round, but it seems like I will just need to focus on specific aspects of the book.

So, in this whirlwind of activity, I went through the preamble to my methods section, my target participant descriptions, my data collection, my data analysis techniques, and any limitations.  I added to these sections, explicated, went more in-depth in each section, I corrected issues that were brought up by Debra in EDDE 805, some outstanding issues and comments from the feedback on the parts I had worked on MDDE 702, and some of the initial comments I got back from my dissertation chair. **phew** That was hard work!  The only parts that I still have left to complete in order to be "done" with my methods section are (1) The ethics section; (2) the validity/reliability/bias section;  (3) a conclusion section for the chapter bringing it all together; (4) an appendix with a sample survey; and (5) an appendix with the participant consent form.  I am considering adding (6) the REB application to an appending as well before I call this section "done".  I am not sure if I will be done by August 30th (as was the original plan) but I think I will be damn close.

That said, there is one thing that is tripping me up, and that has to do with the validity/reliability/bias section.  Bias is actually not that hard.  I think I can write up procedures and things to be on the lookout for in order to avoid bias in both data collection and analysis.  The thing that  is much more concerning is philosophical:  Do I go with Trustworthiness, Credibility, Dependability, and Transferability as what I talk about in this section (coming from the Lincoln and Guba tradition of qualitative research work)?  Or do I choose the more traditional Validity and Reliability and discuss my methods in that frame of reference?  Of course, for qualitative studies the Lincoln & Guba approach makes sense (at least it does to me, and it's references in a variety of other texts I've read on qualitative approaches to research), but at the same time quite a few of the texts that I've read (both on case studies and on qualitative studies in general) still use reliability and validity as terms in qualitative researcher. So, so I "translate" validity and reliability (from the texts) in Lincoln & Guba terms?  Just discuss in the framework of Lincoln & Guba? or try to smash both together?  Perhaps start with Validity & Reliability and transition to L&G terms since they make sense?    I need to re-read Chapter 11 of Naturalistic Inquiry this week to help make up my mind (any thoughts are more than welcome in the comments).

As of this point I am at 23 pages (with 1 paragraph of lorem ipsum text, and quite a few scraps of though patterns for items 1 and 2 above), so I am thinking I should be wrapping this up soon and not getting logorrhea.

Comments

Post a Comment

Popular posts from this blog

Academic Facepalm (evaluation edition)

Image
Back in December, I was searching for the #tenure hashtag on twitter.   There was some discussion (probably stated by Jesse Stommel 😜) which prompted me to search for this #hashtag out of curiosity to see what was tagged.  Along with heartwarming stories of people who've just earned tenure (a nice perk right before the winter break!), there was this wonderful tweet specimen... I'm not gonna lie.  IT BUGS ME. It bugs me as a learner.   I've always completed course evaluations and I tried to give honest feedback to the professor.  If the course was easy, hard, just right, I wanted them to know.  If I was appreciative, I wanted them to know.  Yes, sometimes I've half-assed it and just completed the Likert scale with a "loved the course" comment at the end, but many times I try to be more concrete about the feedback. It bugs me as a program manager. I am the individual who sets up, collects, and often reminds students, about the course evaluations.  M
Read more

Discussion forums in MOOCs are counter-productive...well, sort of...

Image
The other day I was reading this blog post on why MOOC forums are counter-productive .  I was really thinking hard about this and my initial inclination is to agree. Forums, in MOOCs, are  counter-productive. But, as with most things in life, there is a big asterisk here. If we look at how MOOCs are setup, and by MOOC here I mean xMOOC since that's what most people think of, the discussion board is one big crazy mess. Coursera has done something interesting in crowdsourcing thread relevancy by allowing people to up-vote or down-vote threads, but at their core these discussions are setup like every other discussion forum out there in traditional education: There usually is a prompt that people will answer, and answers can be repetitive as well, so when you are the 1000th poster to a question prompt and you see that others have answered something similar to your answers, what is the motivation to wade through many, many, many similar answers in order to find the subtle contextual
Read more

Latour: Third Source of Uncertainty - Objects have agency too!

Image
Continuing on my exploration of ANT, and asynchronous and indirect dialogue with Latour - this blog post will cover the third source of uncertainty, which according to Latour, is that Objects have agency too! As with the previous blog posts, I've pulled out quotes from the book that seemed interesting, or that I reacted to in some way, and I am responding to them here. no tie can be said to be durable and made of social stuff (p. 66) This quote seems to continue Latour's assertion that there is no such thing as "social" or "social stuff" and that "social", or the meaning of needs to be negotiated and better understood.  It also continues the thought that social can only be seen from the actions of its actors, the traces they leave behind, and that these bonds are not durable because they need continuous reinforcement. I guess Social is a perishable item. Left to its own devices, a power relationship that mobilizes nothing but social skil
Read more