Spartan Studios Playkit: Appendix

Appendix

This is the ninth and final article in our iTeach.MSU playlist for the Spartan Studios Playkit.

This appendix includes categories related to different elements of interdisciplinary, experiential teaching and course design, and includes what we hope are useful annotations.

Research from the Spartan Studios project

  • Heinrich, W. F., Louson, E., Blommel, C., & Green, A. R. (2021). Who Coaches the Coaches? The Development of a Coaching Model for Experiential Learning. Innov High Educ 46, 357–375. https://doi.org/10.1007/s10755-020-09537-3 

This paper is an overview of the Spartan Studios project and our results for students and faculty who ran prototype courses. It outlines the GORP model as well as the benefits and challenges of this approach to teaching and course planning.

  • Heinrich, W. F., Lauren, B., & Logan, S. (2020). Interdisciplinary teaching, learning and power in an experiential classroom. Submitted to Experiential Learning & Teaching in Higher Education.

This paper [under review] describes the first iteration of what became the Studios pattern at MSU and introduces the GORP framework.

 

Research from the James Madison University X-Labs, our colleagues in Virginia working in a similar course model

  • McCarthy, S., Barnes, A., Briggs, F., Giovanetti, K., Ludwig, P., Robinson, K., & Swayne, N. (Fall 2016). Undergraduate Social Entrepreneurship Education and Communication Design. SIGDOC 2015 Conference Proceedings. https://doi.org/10.1145/2987592.2987625 

This report describes some communication strategies within the X-Labs’ drones course, how students documented and presented their works and how faculty plan to iterate the course.

  • Ludwig, P. M., Lewis, E. J., Nagel, J. K. (2017). Student learning outcomes from a pilot medical innovations course with nursing, engineering and biology undergraduate students. International Journal of STEM Education, 4(33) https://doi.org/10.1186/s40594-017-0095-y 

Describes an X-Labs multidisciplinary course on medical innovations and its assessment using qualitative content analysis about students’ attitudes and perceptions of different occupations.

  • McCarthy, S., Barnes, A., Holland, S. K., Lewis, E., Ludwig, P., & Swayne, N. (2018). Making It: Institutionalizing Collaborative Innovation in Public Higher Education. Proceedings of the 4th International Conference on Higher Education Advances (HEAd’18) 1,549–1,557. http://dx.doi.org/10.4995/HEAD18.2018.8560  

A descriptive case study of the academic maker space in the JMU X-Labs, both describing specific courses and how X-Labs is administered. Offers this model as applicable elsewhere in higher ed.

Describes cross-disciplinary courses as promoting entrepreneurship and innovation, by looking at startups coming from these courses. Offers a framework based on multidisciplinary problem-solving, Design Thinking approaches, and a lean startup methodology.

A rebuttal to an argument that higher ed’s emphasis on innovation is misguided. Argues that innovation has positive student outcomes, is different from entrepreneurship, and that their interventions are effective.

  • Swayne, N., McCarthy, S., Selznick, B. S., & Fisher, K. A. (2019). Breaking up I/E: Consciously Uncoupling Innovation and Entrepreneurship to Improve Undergraduate Learning. Innovation and Entrepreneurship Theory and Practice. https://doi.org/10.24251/HICSS.2019.651  
Describes the X-Labs as evidence for uncoupling entrepreneurship and innovation, and argues that conceptually they are separate; teaching innovation needs to precede teaching entrepreneurship
  • Lewis, E. J., Ludwig, P. M., Nagel, J., & Ames, A. (2019). Student ethical reasoning confidence pre/post an innovative makerspace course: A survey of ethical reasoning. Nurse Education Today, 75, 75-79. https://doi.org/10.1016/j.nedt.2019.01.011 

Describes gains to ethical reasoning after the Medical Innovations X-Labs course.

  • El-Tawab, S., Sprague, N. & Stewart, M. (2020). Teaching Innovation in Higher Education: A Multidisciplinary Class. In D. Schmidt-Crawford (Ed.), Proceedings of Society for Information Technology & Teacher Education International Conference (pp. 8-13). Association for the Advancement of Computing in Education (AACE). https://www.learntechlib.org/primary/p/215725/

Describes a case of the X-Labs autonomous vehicles course, its support of students’ technical and soft skills, and its reproducibility.

Chronicle of Higher Education story about the JMU X-Labs course model.


Interdisciplinarity

Offers a framework for thinking about different disciplinary connections, from disciplines being isolated/siloed from each other through transdisciplinarity.

  • Carmicheal, T. & LaPierre, Y. (2014). Interdisciplinary Learning Works: The Results of a Comprehensive Assessment of Students and Student Learning Outcomes in an Integrative Learning Community. Issues in Interdisciplinary Studies, 32(3), 53–78. http://hdl.handle.net/10323/6647 

Evidence-based assessment of student learning outcomes and academic growth metrics as a result of participation in a first-year integrative learning community. The author outlines the interdisciplinary learning goals and processes of the program, and shows that students that participated in the program consistently outperformed students outside of the program in both short term and long term learning and academic growth benchmarks. 

  • Ivanitskaya, L., Clark, D., Montgomery, G., & Primeau, R. (2002). Interdisciplinary Learning: Process and Outcomes. Innovative Higher Education, 27, 95–111. https://doi.org/10.1023/A:1021105309984 

A review of expected benefits, learning outcomes, and processes (and potential roadblocks) of interdisciplinary education. Review applied to an interdisciplinary discussion based course. The authors claim that interdisciplinary learning can significantly contribute to intellectual maturity and cognitive development of students, and provide a framework of milestones that students may hit in the process of cognitive development through interdisciplinary ed. 

This magazine article argues for the benefits of interdisciplinary education for both students and institutions, and provides ways to encourage interdisciplinary education on a systemic level. The authors give key strategies and tips for facilitating interdisciplinary learning and creating student experiences. The barriers to interdisciplinary learning/education are recognized (specifically institutional) and potential solutions are given as well. 

  • Stentoft D. (2017) From saying to doing interdisciplinary learning: Is problem-based learning the answer? Active Learning in Higher Education, 18(1). 51–61. https://doi.org/10.1177/1469787417693510
Author argues that PBL is an effective strategy to facilitate interdisciplinary learning and vice versa. The author also acknowledges three barriers to effective interdisciplinary education: curriculum organization, student competencies to navigate interdisciplinary problems, and instructor competency – and proposes how to address these barriers.  
  • Imafuku, R., Kataoka, R., Mayahara, M., Suzuki, H., & Saiki, T. (2014). Students’ Experiences in Interdisciplinary Problem-based Learning: A Discourse Analysis of Group Interaction. Interdisciplinary Journal of Problem-Based Learning, 8(2). https://doi.org/10.7771/1541-5015.1388 
  • Kruck, S. E. and Teer, Faye P. (2009). Interdisciplinary Student Teams Projects: A Case Study. Journal of Information Systems Education, 20(3), 325–330. https://aisel.aisnet.org/jise/vol20/iss3/7  

 

Problem-Based Learning/Project-Based Learning 

  • Ertmer, P. A., & Simons, K. D. (2006). Jumping the PBL Implementation Hurdle: Supporting the Efforts of K–12 Teachers. Interdisciplinary Journal of Problem-Based Learning, 1(1). https://doi.org/10.7771/1541-5015.1005

While focused on problem based learning at the K-12 level, this paper covers topics relevant to higher education instruction, including implementation challenges, creating collaborative classroom culture, teachers adjusting to changing roles, scaffolding student learning, initiating student inquiry, maintaining student engagement, aiding conceptual integration, and promoting reflective thinking

Study of student perceptions of problem-based learning in an anthropology course found that students with more subject matter experience didn’t necessarily have greater intrinsic motivation about the course. Also includes strategies for transitioning students to PBL when they are used to traditional lectures.

  • Guo, P., Saab, N., Post, L. S., & Admiraal, W. (2020). A review of project-based learning in higher education: Student outcomes and measures. International Journal of Educational Research, 102, 101586. https://doi.org/10.1016/j.ijer.2020.101586

A review of literature around project based learning that includes 76 papers. Topics covered in the review include cognitive outcomes of PjBL including knowledge and cognitive strategies, affective outcomes including perceptions of the benefits of PjBL and perceptions of the experience of PBL, and behavior outcomes including skills and engagement

  • Lee, J. S., Blackwell, S., Drake, J., & Moran, K. A. (2014). Taking a leap of faith: redefining teaching and learning in higher education through project-based learning. Interdisciplinary Journal of Problem-Based Learning, 8(2). https://doi.org/10.7771/1541-5015.1426

Study of instructors who implemented PjBL that focused around their challenges and successes with community partnerships, student engagement, and assessment

15 strategies for scaffolding learning and supporting students in PBL programs includes using a phased approach to PBL, getting student feedback in the first few weeks of the program, and develop learner’s reflective skills before self-assessment

  • Pepper C. (2010). There’s a lot of learning going on but NOT much teaching!’: Student perceptions of problem‐based learning in science. Higher Education Research & Development, 29(6), 693-707. https://doi.org/10.1080/07294360.2010.501073 

Overview of student responses to problem based learning at an Australian university. Developed a continuum of how students react to problem based learning that includes missing the point, working in groups, splitting the workload, completing the task, assessing the task, learning new information, sharing ideas, and being self directed learners

  • Perrault, E. K., & Albert, C. A. (2018). Utilizing project-based learning to increase sustainability attitudes among students. Applied Environmental Education & Communication, 17(2), 96-105. https://doi.org/10.1080/1533015X.2017.1366882 

While PjBL is often concerned with knowledge gain, this study suggests that PBL can also shift student attitudes around the topic. For this study, students designed a communications campaign for an office of sustainability. The students themselves were found to have more favorable views around sustainability by the end of the course

Brief overview of what project based learning is and four key steps to implementing it (defining the problem, generating ideas, prototyping solutions, and testing)

  • Strobel, J., & van Barneveld, A. (2009). When is PBL more effective? A meta-synthesis of meta-analyses comparing PBL to conventional classrooms. Interdisciplinary Journal of Problem-Based Learning, 3(1). https://doi.org/10.7771/1541-5015.1046  

Combines the results of many meta-analyses around PBL over the last few decades to compare PBL to traditional classroom learning. The study finds that PBL results in more satisfaction among students and faculty, leads to better long term retention of knowledge (traditional was better for short-term), and better skill development

  • Vogler, J. S., Thompson, P., Davis, D. W., Mayfield, B. E., Finley, P. M., & Yasseri, D. (2018). The hard work of soft skills: augmenting the project-based learning experience with interdisciplinary teamwork. Instructional Science, 46(3), 457-488. https://doi.org/10.1007/s11251-017-9438-9 

Two-year study of an interdisciplinary problem based learning task and student outcomes. Study used student feedback during each year to understand how students were feeling about the course. The instructors learned that students felt the instructors had inconsistent and unclear expectations and hence, experienced anxiety about grades. The instructors took this to mean that they needed to do a better job of articulating the learning outcomes and end of course goal. The instructors also learned that students often do not know how to collaborate interdisciplinary and decided to add scaffolding to the course

 

Learning Objectives and Bloom’s Taxonomy 

Overview of the original 6 levels of Bloom’s Taxonomy and the 6 levels of the Revised Taxonomy: remember, understand, apply, analyze, evaluate, and create. Includes the four types of knowledge: factual, conceptual, procedural, and metacognitive.

Strategies and tips for articulating and writing learning objectives including that learning objectives should be student-centered, break down the task and focus on specific cognitive processes, use action verbs, and be measurable.

Example of an interdisciplinary high school course (English & social studies) where the two instructors used a taxonomy table to map their learning objectives onto the 6 levels of the Revised Taxonomy and 4 types of knowledge. Such a table may be useful for thinking about the learning objectives in your course

  • Kidwell, L. A., Fisher, D. G., Braun, R. L., & Swanson, D. L. (2013). Developing learning objectives for accounting ethics using Bloom’s taxonomy. Accounting Education, 22(1), 44-65. https://doi.org/10.1080/09639284.2012.698478 

An example of using Bloom’s Taxonomy in accounting ethics to create learning objectives. For each larger course theme, the authors list examples how learning objectives could be created from each level of the Taxonomy.

Includes 19 processes/action verbs, how they map to the 6 levels of the Revised Taxonomy, and simple examples of what a task for students to do might look like. Examples of included verbs are “compare,” “implement,” “organize,” “critique,” and “generate”

An example of using Bloom’s taxonomy to map course activities to ensure students have the prerequisite knowledge to complete the assignments 

 

Reflection; Reflection as Assessment

  • Ash, S. L., & Clayton, P. H. (2009). Learning through critical reflection: A tutorial for service-learning students. Ash, Clayton & Moses.

Introduces characteristics of critical reflection and the DEAL model.

  • Eyler, J., Eyler, J., Giles, D. E., & Schmeide, A. (1996). A practitioner’s guide to reflection in service-learning: Student voices & reflections. Vanderbilt University.

Argues that successful reflection is continuous, challenging, connected, and contextualized.

  • Earl, L. M. (2012). Assessment as learning: Using classroom assessment to maximize student learning (2nd edition). Corwin Press.

Especially chapter 10, Using Assessment for Reflection and Self-Regulation

  • Ash, S. L., Clayton, P. H., & Atkinson, M. P. (2005). Integrating reflection and assessment to capture and improve student learning. Michigan Journal of Community Service Learning, 11(2), 49-60. http://hdl.handle.net/2027/spo.3239521.0011.204 

Sees coupled reflection and assessment as mutually informing and reinforcing for students in service learning. Describes tools to guide reflective writing processes. Focus on both individual student learning and reflection as part of program-wide approaches to reflection.

 

Assessment of Experiential Education & Interdisciplinary Learning 

A summary of the research of the Evaluation of Experiential Learning project which sought to (1) assess the impact of experiential learning on secondary school students and (2) use that data to identify the elements of the EE programs that contributed the most to such student development.

In-depth discussion of assessment techniques for interdisciplinary study in higher education

  • Heinrich, W. F., Habron, G. B., Johnson, H. L., & Goralnik, L. (2015). Critical thinking assessment across four sustainability-related experiential learning settings. Journal of Experiential Education, 38(4), 373–393. https://doi.org/10.1177/1053825915592890  

Implications of critical thinking coupled with engaged citizenry within experiential education courses.

  • Mansilla, V. B., & Duraising, E. D. (2007). Target assessment of students’ interdisciplinary work: An empirically grounded framework proposed. The Journal of Higher Education, 78(2), 215-237. https://doi.org/10.1080/00221546.2007.11780874  

Introduction of a framework for targeted assessment of interdisciplinary student work. Also a good review of relevant literature of assessment and interdisciplinary learning in higher education.

  • Yates, T., Wilson, J., & Purton, K. (2015). Surveying assessment in experiential learning: A single campus study. The Canadian Journal for the Scholarship of Teaching and Learning, 6(3). https://doi.org/10.5206/cjsotl-rcacea.2015.3.4  

Exploration of experiential assessment within a Canadian University. Exploration intended for the use in identifying common methods and facilitating development of best assessment practices for higher education, specifically experiential higher education.

  • You, H. S., Marshall, J. A., & Delgado, C. (2019). Toward interdisciplinary learning: Development and validation of an assessment for interdisciplinary understanding of global carbon cycling. Research in Science Education. https://doi.org/10.1007/s11165-019-9836-x  

Development and validation of an assessment which measured the understanding of the carbon cycle for high school and undergraduate students.

Building and Managing Student Teams & Team Dynamics 

  • Burke, A. (2011) Group Work:  How to Use Groups Effectively. Journal of Effective Teaching, 11(2), 87-95. https://uncw.edu/jet/articles/vol11_2/burke.pdf 
  • Cano, J. L., Lidon, I., Rebollar, R., Roman, P., & Saenz, M. J. (2006). Student groups solving real-life projects. A case study of experiential learning. International Journal of Engineering Education, 22(6), 1252-1260. https://www.ijee.ie/articles/Vol22-6/16_IJEE1811.pdf 
  • Fearon, C., McLaughlin, H., & Yoke Eng, T. (2012). Using student group work in higher education to emulate professional communities of practice. Education + Training, 54(2/3), 114–125. https://doi.org/10.1108/00400911211210233  
  • Fellenz, M. R. (2006). Toward fairness in assessing student groupwork: A protocol for peer evaluation of individual contributions. Journal of Management Education, 30(4), 570–591. https://doi.org/10.1177/1052562906286713   
  • Furman, R., Bender, K., & Rowan, D. (2014). An experiential approach to group work. Oxford University Press.
  • Smith, G. G., Sorensen, C., Gump, A., Heindel, A. J., Caris, M., & Martinez, C. D. (2011). Overcoming student resistance to group work: Online versus face-to-face. The Internet and Higher Education, 14(2), 121–128. https://doi.org/10.1016/j.iheduc.2010.09.005  
  • Hassanien, A. (2006). Student Experience of Group Work and Group Assessment in Higher Education. Journal of Teaching in Travel & Tourism, 6(1), 17–39. https://doi.org/10.1300/j172v06n01_02  
  • Kayes, A. B., Kayes, D. C., & Kolb, D. A. (2005). Experiential learning in teams. Simulation & Gaming, 36(3), 330–354. https://doi.org/10.1177/1046878105279012  
  • Napier, N. P. & Johnson, R. D. (2007). Technical Projects: Understanding Teamwork Satisfaction In an Introductory IS Course. Journal of Information Systems Education. 18(1), 39-48. http://www.jise.org/volume18/n1/JISEv18n1p39.html 
  • Winsett, C., Foster, C., Dearing, J., & Burch, G. (2016). The impact of group experiential learning on student engagement. Academy of Business Research Journal. 3, 7-17. 

 

Online Experiential Education and Innovative Online Teaching & Course Structures

Provides insights on how to implement an experiential learning framework into an already developed online course.

  • Christian, D. D., McCarty, D. L., & Brown, C. L. (2020). Experiential education during the COVID-19 pandemic: A reflective process. Journal of Constructivist Psychology, 1–14. https://doi.org/10.1080/10720537.2020.1813666  

Provides insight on how experiential learning can occur in an online format which acknowledges the new normal due to the COVID-19 pandemic. This includes case studies.  

Piece on how to keep students thoughtfully engaged with online courses.

 

Diversity, Equity, and Inclusion

  • Canning, E. A., Muenks, K., Green, D. J., & Murphy, M. C. (2019). STEM faculty who believe ability is fixed have larger racial achievement gaps and inspire less student motivation in their classes. Science Advances, 5(2). https://doi.org/10.1126/sciadv.aau4734  

Students in classes where the instructor believed that student potential was fixed earned lower grades than in courses where the instructor believed student potential changed over time. In addition, the difference in grades between students from underrepresented racial groups and white/Asian students was larger in the classes with instructors who thought mindset was fixed. 

A set of broad guidelines for ensuring that all learners can engage in learning, regardless of culture, language, or disability status. Each guideline includes practical examples of how it could be implemented in a course and the research supporting the guideline. 

Guide that covers why instructors need to develop self-awareness and empathy for students and consider classroom climate before pedagogical choices for inclusivity. Also includes an interactive webpage about inclusive teaching with literature citations and a checklist for instructors. 

A guide about personal pronouns and best practices for using them: include your pronouns when introducing yourself, avoid using “preferred” in front of pronouns, and using “go by” instead of “uses” when introducing pronouns. E.g. My name is Sparty and I go by him/his pronouns. 

A self-reflection tool for instructors about their teaching practices measured along five dimensions: critical engagement of difference, academic belonging, transparency, structured interactions, and flexibility. Each dimension includes ideas for instructors to add to their own courses 

Includes 9 recommendations instructors can take to create a more inclusive classroom including incorporating diversity into the curriculum, examining implicit biases, adding a diversity statement to the syllabus, and soliciting student feedback 

Photo from LubosHouska from Pixabay