BMSD : 10.65048
BMSD : 10.65048
https://doi.org/10.65048/ijbmr
Search
About Us
Authors
Reviewers
Editorial Board
Contact Us

International Journal of Biological and Medical Research (IJBMR)

Original Article
Year : 2026  |  Volume : 17  |  Issue : 3  |  Page : 8582-8586 Full Version
Evaluation of research methodology workshop for first year postgraduates by kirkpatrick's model
Int J Biol Med Res. 2026; 17(3): 8582-8586  |  DOI: 10.65048/ijbmr.2026.17.3.8582.1047
*Papa Dasari, Vasudevan .S, Balan.S, Rangasamy .S, Ratnasamy .S
Dean Research & PG Academics: Sri Venkateshwaraa Medical College Hospital and Research Centre (SVMCH&RC), Puducherry, INDIA
Correspondence Address :
Papa Dasari,
Dean Research & PG Academics:
Sri Venkateshwaraa Medical College Hospital and Research Centre (SVMCH&RC)
Puducherry, INDIA E-mail: dasaripapa@gmail.com
Received: February 15, 2026 Accepted: April 29, 2026 Published: July 3, 2026

Abstract
Background: Learning Research Methodology is a basic requirement for the postgraduates before they embark to carry out their dissertation work which is mandatory for obtaining their postgraduate degree. Workshop is one of the teachings – learning activities to achieve the goal and its effectiveness needs to be assessed for improving the process. Objectives: 1. To evaluate the student’s perception and learning regarding T-L methods of Research methodology workshop and modify the programme later as per the results of Pre-test and Post Questionnaire and feedback for the students. To evaluate the effectiveness of the research methodology workshop by applying the Kirkpatrick's evaluation model. Material and Methods: A 2- day Research methodology workshop programme approved by the Research and Medical education departments was circulated to the first year post-graduate students 15 days ahead along with the study material involving Scientific research committee and Ethical committee protocols and ICMR Ethical Guidelines A pretest and posttest was obtained by Questionnaire method on each day and Feedback form at the end of the programme through google forms. Satistical analysis: Pre-test and post-test scores were compared by using paired t-test. Feedback results were analysed by 5 point Likert scale. The programme outcome was evaluated by applying the 4 levels of Kirk patricks model.
Results: Of the 122 students maximum114 undertook pre and posttest and 85 filled the feed- back forms. There was a statistically significant improvement post test scores on both days (p 0.0001) By applying the Kirk patricks evaluation the programme was effective and the important modification needed was to deliver the contents across more hours of learning. Conclusion: The programme was effective in improving perception, knowledge, and skills of the first year postgraduates in Research methodology. The research methodology workshop evaluation by kirk Patricks model achieved all 4 levels. As per the feedback the learning hours for the programme need to be increased and spanned over a week.
Keywords
Research methodology, Workshop, First year post graduates, Pretest and posttest, Feedback , Kirk Patricks model

Introduction

Research methodology is essential for any project to be undertaken and the students when they enter postgraduate course are mostly new to undertake Research project in a scientific way. Hence teaching Research methodology has become a norm and the National Medical Council has made it mandatory to carry out this task soon after the Postgraduates join the course. The aim of teaching   Research methodology for the first year postgraduates is to make them understand the basics of Research, Ethical aspects of Research under which conditions they can undertake research and on whom they can perform  such research and   benefits  as well as the  harms to the Society. “Workshop”  is one such Teaching Learning method (T-L Method) to achieve the goal. The word Workshop originally meant ‘a place where things are made or repaired’ but nowadays workshop means ‘an arrangement where a group of people learn, acquire new knowledge, perform creative problem solving and or innovate in their respective domains on a specific issue’[1].  At  the end of the  Research methodology workshop  the student should  be able to independently write a Research Protocol, get necessary approvals, perform the Research ethically and analyse and report the results as well as the limitations and the strengths of the Research project. Any Research project outcome  needs to be known to the other Scientists and the Public to benefit the community and hence they also need to acquire the skills for publication. Planning, delivering the Teaching Learning methods and evaluating such methods is important for improvement  of any such programmes.. There are various methods of evaluating Research methodology programmes like CIPP (Context, Input, Process,Product)  Krick Patrick  model (Reaction,Learning,Behaviour,Results)  UFE  (Utilisation Focussed Evaluation), CIPRO . Out of these Krick Patricks model is most applicable to Health care Research Methodology [2,3]

Hence it is aimed to objectively evaluate the Research methodology workshop that was conducted for the first year postgraduates by applying the principles of Krik Patricks model. This manuscript describes the conduct of Research methodology Workshop for the first year postgraduates and its evaluation by pre-test and post test Questionnaire , Feed back from the students  and the outcome of the programme.

Materials and Method

The departments of Research and Development the Medical Education Unit of Sri Venkateshwaraa Medical College Hospital and Research Centre collaboratively conducted the programme in the month of May 2025. The objectives and the Schedule of the programme was drafted by the Dean Research along with the Medical Education Unit Co-ordinator and was approved by all the faculty involved in the programme after due discussions in a prior meeting.. The faculty included were the Director, Dean Research present and past, Chairman Scientific Research Committee, Member Secretary Ethics Committee, Member Secretary of Animal Ethics Committee, Co-ordinator of Medical Education Unit, Faculty of Bio-Statistics and other eminent faculty who had training in Research methodology  or training in Basic Course in Medical Education (BCME) / Advavanced Course in Medical Education (ACME).

The final Research methodology workshop programme for 2 days was circulated to the first year post-graduate students and the faculty 15 days ahead along with the objectives, ethical guidelines of ICMR, Teaching learning material of protocols of Scientific  and Ethics committee. The objectives of the workshop included sensitization regarding the rules and regulations of National Medical Council, Basics of various types of Research, the process of conducting the Research, Ethical Principles in research and misconduct, the protocols of Scientific Research Committee (SRC) and Ethics committee (IEC) and obtaining the approvals, methods of Data collection and Data analysis and manuscript writing etc.  

The Schedule for 2 working days from 9 am to 4 PM with student’s active involvement as presentation of the model protocols from 3 to 4 PM. There were 2 breaks of half an hour each for tea and Lunch.  A pre-test Questionairre which was prepared by contribution of each faculty for their session. The questionnaire were prepared as per the guidelines for Pre and Post-testing[4] and consisted of  22 Multiple choice Questions. The  link  was shared via  google-form (https://docs.google.com/forms/d/e/1FAIpQLSdPKvKLWwCqtsjJglK-fYsegEUYt81WUBxFBK3bCQbT2NP1-w/viewform?usp=dialog) prior to the start of the programme between 8.30AMto 9AM .The post –test Questionnaire link (https://docs.google.com/forms/d/e/1FAIpQLSdH2ULWDA3QHDFVNy-L21sTMIDbolug4a5vWy0hNahmMZTEXQ/viewform?usp=dialog) was shared at 4 PM and to be filled by 5 PM. At the end of the 2 day program  link for feed back form which included rating  scale of 5 (Likert rating scale). The feed back form also included space for comments for improvement and also drawbacks . The Krik Patricks model was applied in analyzing the effectiveness of the programme. Statistical Analysis: Data were entered in Microsoft Excel 2010 and data were analyzed by using SPSS 23.0 version. Tests scores were normally distributed and it was confirmed by Kolmogorov-Smirnov test.  Pre-test and post-test scores were compared by using paired t-test.  p-value < 0.05 was considered as statistically significant. Feedback results were analysed by 5 point Likert scale . Rate of 5 stars was taken as excellent, 4 as very good and 3 as good and combinedly this denotes that the session was satisfactory and does not need repetition or modification. Two star was taken as poor and one star as very poor and needs repetition or modification subsequently if more than 50% marked it.

Results

There were 123 first year postgraduates who attended the programme. Majority belonged to clinical departments (87.8%) mainly General Medicine (15%), General Surgery (15%), Obstetrics and Gynaecology (8.9%) and Paediatrics (7%) (Table -1).

 Day 1 pre-test and post evaluation is shown in Table 2. There were 114 (92.6%) participants and the mean pre-test score was 12.29 with a standard deviation of 4.037 and post test score was 14.92 with a standard deviation of 2.414. Test scores were normally distributed as confirmed by Kolmogorov-Smirnov test .The  paired t-test value was -6.039 with p-value = 0.0001 which shows significant improvement.

TABLE 2: Day 1 Pretest & Post Test Results

Paired Samples Statistics

Pair 1

Pre_Test_Score

Mean

12.29

N

114

Std. Deviation

4.037

Std. Error Mean

0.378

Post_Test_Score

Mean

14.92

N

114

Std. Deviation

2.414

Std. Error Mean

0.226

Paired Samples Correlations

Pair 1

Pre_Test_Score & Post_Test_Score

N

114

Correlation

.024

Sig.

0.799

Paired Samples Test

Pair 1

Pre_Test_Score - Post_Test_Score

Paired Differences

Mean

-2.632

Std. Deviation

4.653

Std. Error Mean

.436

95% Confidence Interval of the Difference

Lower

-3.495

Upper

-1.768

t

-6.039

df

113

Sig. (2-tailed)

0.0001

One hundred and two students (82.9%) filled the pre and post test Questionnaire on Day 2. The mean pre-test score was 11.3 with a standard deviation of 4.567 and post=test score was 15.27 with a standard deviation of 1.961, the paired t-test value was -7.095 with p-value = 0.0001 .(Table 3). Figures 1 &2  represent the  pre-test and post test results.

TABLE: 3  Day 2 – Pre and Post Test  results T-Test

Paired Samples Statistics

Pair 1

Pre_Test_Score

Mean

11.75

N

102

Std. Deviation

4.57

Std. Error Mean

0.452

Post_Test_Score

Mean

15.27

N

102

Std. Deviation

1.96

Std. Error Mean

0.194

Paired Samples Correlations

Pair 1

Pre_Test_Score & Post_Test_Score

N

102

Correlation

-.021

Sig.

.833

Paired Samples Test

Pair 1

Pre_Test_Score - Post_Test_Score

Paired Differences

Mean

-3.520

Std. Deviation

5.010

Std. Error Mean

.496

95% Confidence Interval of the Difference

Lower

-4.504

Upper

-2.535

t

-7.095

df

101

Sig. (2-tailed)

0.0001

 Out of 123, 85 students   filled  the feed back forms  and the response rate was 69%. All the sessions were rated more than 3 stars . The sessions on manuscript writing, Data entry and soft ware application (SPSS)  and interim analysis may need clarity as 4 to 5% rated them as 2 star and 1 star.

TABLE 4: FEEDBACK RESULTS:( N=85)

S. NO

NAME OF THE SESSION

RATING SCALE

5 STAR N (%)

(Excellent)

4 STAR

N( %)

(Very Good)

3 STAR

N (%)

( Good)

2STAR

N ( %)

(Poor)

1STAR-

  N ( %)

(Very Poor)

1

Objectives of the Programme Basics of research  & Research methodology

40 (47)

31(36)

14(17)

0

0

2

 Rules and Regulation as per PGMEB

34(40)

34(40)

15(18)

1(1)

1(1)

3

Selection of Topic for Thesis and Responsibilities

37(44)

29(34)

18(21)

1(1)

0

4

Framing title of the study

38(45)

35(41)

10(12)

1(1)

1(1)

5

Subject recruitment for various studies.

 38(45)

32(38)

12(14)

2(2)

1(1)

6

Conduct of Clinical trials and Research involving animals

38(45)

33(39)

10(12)

2(2)

2(2)

7

Protocol preparation and submission for SRC

39(46)

32(38)

12(14)

1(1)

1(1)

8

Elements of Informed Consent

39(46)

32(38)

13(15)

1(1)

0

9

Protocol preparation and submission for IEC

39(46)

33(39)

11(13)

1(1)

1(1)

10

Students  Presentation

40(47)

44(40)

11(13)

0

0

11

Data Entry ,Data Analysis ,Software's

37(44)

30(35)

14(17)

3(3)

1(1)

12

 Interim Analysis:

42(49)

26(31)

13(15)

3(4)

1(1)

13

Writing Review of Literature

41(48)

26(31)

16(19)

1(1)

1(1)

14

 Writing Observation/Results

47(55)

21(25)

15(18)

1(1)

1(1)

15

Writing Discussion  and references

43(51)

28(33)

12(14)

0

2(2)

16

Limitations and Strengths , Summary conclusions, Implications

39(46)

28(33)

16(19)

1(1)

1(1)

17

Abstract- Formats

39(46)

27(32)

17(20)

1(1)

1(1)

18

 Bibliography-Softwares

39(46)

29(34)

14(17)

2(2)

1(1)

19

Writing Manuscript for Publication

39(46)

29(34)

12(14)

4(5)

1(1)

20

Protocol Presentation by Students

38(45)

33(39)

11(13)

1(1)

2(2)

The other  feed back comments included that the sessions are long and the programme could be spanned over 5 days to one week and  few students (5) felt that it should be conducted as a half a day programme and data analysis  session needs a separate day to be dealt with.

Discussion

The ultimate goal of Research methodology workshop for students is to make them understand the basics of research and its foundation and to innovate and conduct research in an ethical way which is safe to humans. To achieve this goal Institutes adopt various ways of teaching and each Institute has its own way of conducting these workshops though the content remains basically the same. Whether the teaching learning methods has made an impact is also essential to improve the efficacy of the programme. The role of pre and post test analysis of research methodology workshops in improving the research skills by Bidwe S and collegues found that there was a significant improvement in knowledge and skills about research methods and thesis writing among postgraduates and faculty. They conducted pretest prior to the programme on Day 1 using 20 questionnaire on the  material to be taught during this workshop and post-test was conducted at the end of the workshop on  Day 3. They have combined the scores of each test of 6 workshops and analysed the results [5]. In our study we obtained the Pre test and post-test questionnaire for each day at the end  of the programme so that the knowledge gained can be  fresh in their minds. In 2018, a study on feedback of postgraduate students on Research Methodology was undertaken in which among 44 students, only 13 gave feed back on Day 1, 10 on Day 2 and 10 on Day 3 [6]..They have also used pre-test and post test Questionnaire for evaluation of the Research methodology taught in the workshop and the results were analysed by ‘t’test which showed significant improvement. In the present study, feed back was taken on the same day and overall , 85 participants out of 123 gave complete feedback and response rate was 69%. Organising the content to be delivered effectively is important to evaluate its efficacy later. A study conducted in University Education  Ghana, [7] for evaluating the performance of workshops, organised in to 11 sections and the evaluation was also based on the sections . In the current study we organised the programme under 20 sessions  and the feed back was reported on a rating scale  based on the sessions.

There are various models described in literature to evaluate research methodology workshops. Investigators from Chennai ,  using four levels of  CIRO model for evaluating Research methodology for postgraduates reported significant increase in knowledge , instilled confidence, addressed the learners need and made them competent. The model used context , input , reaction and outcome [8].Kirk Patrick model was used to evaluate research methodology workshop for postgraduates in Kalinga Institute of Medical Sciences ,Odisha. They reported a statistically significant difference in pre- and post test scores using paited t test. The mean ± SD pretest and posttest scores at a 95% confidence interval were 10.55 ± 2.537 and 12.43 ± 2.484, respectively among 132 postgraduate students and these results are almost similar to the present study. We determined pretest and post test scores separately . On Day 1, the mean pre-test score was 12.29 ± 4.037(SD) and post test score was 14.92 ± 2.414 (SD) among 114 respondants. On Day 2, The mean pre-test score was 11.3 with a standard deviation of 4.567 and post=test score was 15.27 with a standard deviation of 1.961 among 102 respondants. The reduction in post-test standard deviation (Day 1: 4.03 → 2.41; Day 2: 4.57 → 1.96) suggests homogenization of knowledge levels among postgraduates, indicating that the workshop. Abdulghani HM and collegues evaluated 5 research methodology workshops by applying Kirk Patrick’s model. Pre and post test evaluation, feed back questionnaire were used and developmental plan reports and behavioural surveys were used to assess effectiveness involving 116 participants.They demonstrated s significant increase in knowledge and skills and the impact was 56.9% of participants starting research, and 6.9% published their research studies. Positive feedback was given by 79% of the participants [2].

 A study  from  Arunachal Pradesh, India aimed  to evaluate the impact of research methodology  included both faculty and Postgraduates . The pretest and post test answers  were compared using Chi-square test and test scores were compared with paired t test. There was a significant improvement in the effectiveness of research methodology workshop and the feed back regarding organisation was constructive and the feed back results rated 43% as excellent and 57 % as good [9]. In the present study, we obtained feed back for each session and more than 45% (range 45%- 55%) rated excellent for majority of sessions. A study conducted for evaluation of research methodology workshop for postgraduates  in SV Medical College, Tirupati, Andhra Pradesh, graded the programme as excellent by 85%. However, the suggestions for improvement included to avoid confrontation among the speakers, to conduct the programme over 2 days rather than a single day , separate workshop for Statistical analysis, elaborate  session on ethics and reference writing and the programme to be conducted with in one month of joining the course. The programme lacked the manscript writing session and Proforma for writing a protocol and for submission to ethical committee [10] . The present study received the following  comments Viz: to conduct the programme only for half a day spreading across a week  and separate workshop for  Sample determination and Data analysis and Bibliography. Sessions on statistics and manuscript writing are inherently skill-based and benefit from hands-on teaching with exercises and examples and this needs to be addressed as we plan to conduct this session in detail once more. Our programme included protocol writing, proforma for SEC and IEC and  also manuscript writing and choosing a journal for publication. After the programme , few had taken help  from statisticians for sample calculation and  all postgraduates could submit their thesis protocol on time.

,When Kirkpatrick's Model is applied , the 4 levels of the model was attained i.e 1. knowledge as per the pre and post test evaluation, 2. Satisfaction as per the results of feed back,3. Behavior as they could write the research protocol 4.impact on organization goals as research output , as 99% of the students submitted their thesis approval after ethical clearance on time to the university.

Conclusions

The Research methodology workshop was effective as it significantly improved the knowledge and skills of the postgraduate students in planning and preparing research protocols as per the ICMR guidelines as well as the Institutional Research guidelines.

The evaluation of this research methodology workshop met the key components of such method (evaluation) as it assessed the knowledge acquisition by scientific methods of pre-test and post test questionnaire. The questionnaires were prepared from the topic which was due to be delivered to meet the objectives of programme.

  It was purpose driven as it aimed to prepare the students to formulate research question, hypothesis and writing the SRC and IEC protocols and data collection Data analysis and finalising the results and analyisng the limitations and strengths of the research for their thesis purpose.

The application of Kirkpatrick’s model provided a structured and comprehensive evaluation framework, supporting its wider use in postgraduate medical education. Refinement of programme duration and modularization of skill-based sessions may further enhance its educational impact.   

Strengths: The programme was evaluated by applying Kirk Patricks model and modifications would be done as per the feedback

Limitations: It is a retrospective analysis and  involved feedback only from students and not from faculty. A feedback from other faculty  may enhance the quality of the prograamme.

Recommendations:  Research methodology programmes need to be evaluated from time to time Qualitatively and Quantitatively as new methods of teaching learning methods are evoloving due to fast digitalization.

 Future workshops could incorporate blended learning, hands-on statistical labs, and follow-up mentoring. Long-term evaluation metrics such as publication rates, protocol quality scores, and supervisor assessments could provide stronger evidence for Quality improvement and sustainability of the programmes.

References

[1]    Ørngreen, R., & Levinsen, K. T. . Workshops as a Research Methodology. Electronic Journal of ELearning, 2017;15(1), 70-81. [569].

[2]    Abdulghani HM, Shaik SA, Khamis N, Al-Drees AA, Irshad M, Khalil MS, Alhaqwi AI, Isnani A. Research methodology workshops evaluation using the Kirkpatrick's model: translating theory into practice. Med Teach. 2014 Apr;36 Suppl 1:S24-9. doi: 10.3109/0142159X.2014.886012. PMID: 24617780. 

[3]    Debata I, Nayak S, Ahmed S, Behera BK, Padhee S. Evaluating a research methodology workshop among postgraduate students using Kirkpatrick’s model. J Edu Health Promot 2024;13:88

[4]  Guideline for Pre-andPost-Testing: International Training and Education Centre for Health. https://www.go2itech.org/HTML/CM08/toolkit/tools/print/tools/skills/TIG_Guidelines_Pre_Post_Test.pdf downloaded on 12th March 2025.

[5]    Bidwe S, Nemade ST, Kamble CG,  Power JD. Role of Research methodology workshop in improving research skills by pre test- post test analysis. Indian Journal of Basic and Applied Medical Research, September 2017: Vol.-6, Issue- 4, P. 74-77.

[6]    Domple VK, Hirwarker PA, Srigiriwar MB. . Feedback of postgraduate students about Research Methodology Workshop. Int J Community Med Public Health. 2019 Jan;6(1):100-104 http://www.ijcmph.com

[7]    Damalie IF, Agbanu P, Fiadzomor P, Akrong S. Evaluation, an Effective Tool for Performance Assessment of Workshops and Events towards Policy Direction in University Education in Ghana. Open Access Library Journal. 2022 Sep 30;9(10):1-1.

[8]    Valarmathi S, Sivaranjani E, Sundar JS, Srinivas G, Kalpana S, et al. (2024) Evaluation of Research Methodology Workshop Using CIRO Model. J Comm Med and Pub Health Rep 5(14): https://doi.org/10.38207/JCMPHR/2024/NOV051405136.

[9]    Sarkar A, Saring N, Sanyal R, Lalin D. Evaluating the impact of a research methodology workshop on medical postgraduates and faculty: A pretest-post-test analysis. Panacea J Med Sci. 2025;15(2):364-368.

[10]    G. Ravi Prabhu, B. Srihari Rao, M. S. Sridhar, K. Ashok Kumar Reddy, PAS Chandrasekharan, D. Shankara Reddy, A. S. Kireeti. “Evaluation of Research Methodology Workshop for Postgraduates in A Medical College, Tirupati.” Journal of Evolution of Medical and Dental Sciences 2015; Vol. 4, Issue 93, November 19; Page: 15868-15872, DOI: 10.14260/jemds/2015/2303.
 


IJBMR -ISSN: 0976:6685. ©Copyright 2026 This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Published by BioMedSciDirect Publications