Research methodology is essential for any project to be undertaken and the students when they enter postgraduate course are mostly new to undertake Research project in a scientific way. Hence teaching Research methodology has become a norm and the National Medical Council has made it mandatory to carry out this task soon after the Postgraduates join the course. The aim of teaching Research methodology for the first year postgraduates is to make them understand the basics of Research, Ethical aspects of Research under which conditions they can undertake research and on whom they can perform such research and benefits as well as the harms to the Society. “Workshop” is one such Teaching Learning method (T-L Method) to achieve the goal. The word Workshop originally meant ‘a place where things are made or repaired’ but nowadays workshop means ‘an arrangement where a group of people learn, acquire new knowledge, perform creative problem solving and or innovate in their respective domains on a specific issue’[1]. At the end of the Research methodology workshop the student should be able to independently write a Research Protocol, get necessary approvals, perform the Research ethically and analyse and report the results as well as the limitations and the strengths of the Research project. Any Research project outcome needs to be known to the other Scientists and the Public to benefit the community and hence they also need to acquire the skills for publication. Planning, delivering the Teaching Learning methods and evaluating such methods is important for improvement of any such programmes.. There are various methods of evaluating Research methodology programmes like CIPP (Context, Input, Process,Product) Krick Patrick model (Reaction,Learning,Behaviour,Results) UFE (Utilisation Focussed Evaluation), CIPRO . Out of these Krick Patricks model is most applicable to Health care Research Methodology [2,3]
Hence it is aimed to objectively evaluate the Research methodology workshop that was conducted for the first year postgraduates by applying the principles of Krik Patricks model. This manuscript describes the conduct of Research methodology Workshop for the first year postgraduates and its evaluation by pre-test and post test Questionnaire , Feed back from the students and the outcome of the programme.
The departments of Research and Development the Medical Education Unit of Sri Venkateshwaraa Medical College Hospital and Research Centre collaboratively conducted the programme in the month of May 2025. The objectives and the Schedule of the programme was drafted by the Dean Research along with the Medical Education Unit Co-ordinator and was approved by all the faculty involved in the programme after due discussions in a prior meeting.. The faculty included were the Director, Dean Research present and past, Chairman Scientific Research Committee, Member Secretary Ethics Committee, Member Secretary of Animal Ethics Committee, Co-ordinator of Medical Education Unit, Faculty of Bio-Statistics and other eminent faculty who had training in Research methodology or training in Basic Course in Medical Education (BCME) / Advavanced Course in Medical Education (ACME).
The final Research methodology workshop programme for 2 days was circulated to the first year post-graduate students and the faculty 15 days ahead along with the objectives, ethical guidelines of ICMR, Teaching learning material of protocols of Scientific and Ethics committee. The objectives of the workshop included sensitization regarding the rules and regulations of National Medical Council, Basics of various types of Research, the process of conducting the Research, Ethical Principles in research and misconduct, the protocols of Scientific Research Committee (SRC) and Ethics committee (IEC) and obtaining the approvals, methods of Data collection and Data analysis and manuscript writing etc.
The Schedule for 2 working days from 9 am to 4 PM with student’s active involvement as presentation of the model protocols from 3 to 4 PM. There were 2 breaks of half an hour each for tea and Lunch. A pre-test Questionairre which was prepared by contribution of each faculty for their session. The questionnaire were prepared as per the guidelines for Pre and Post-testing[4] and consisted of 22 Multiple choice Questions. The link was shared via google-form (https://docs.google.com/forms/d/e/1FAIpQLSdPKvKLWwCqtsjJglK-fYsegEUYt81WUBxFBK3bCQbT2NP1-w/viewform?usp=dialog) prior to the start of the programme between 8.30AMto 9AM .The post –test Questionnaire link (https://docs.google.com/forms/d/e/1FAIpQLSdH2ULWDA3QHDFVNy-L21sTMIDbolug4a5vWy0hNahmMZTEXQ/viewform?usp=dialog) was shared at 4 PM and to be filled by 5 PM. At the end of the 2 day program link for feed back form which included rating scale of 5 (Likert rating scale). The feed back form also included space for comments for improvement and also drawbacks . The Krik Patricks model was applied in analyzing the effectiveness of the programme. Statistical Analysis: Data were entered in Microsoft Excel 2010 and data were analyzed by using SPSS 23.0 version. Tests scores were normally distributed and it was confirmed by Kolmogorov-Smirnov test. Pre-test and post-test scores were compared by using paired t-test. p-value < 0.05 was considered as statistically significant. Feedback results were analysed by 5 point Likert scale . Rate of 5 stars was taken as excellent, 4 as very good and 3 as good and combinedly this denotes that the session was satisfactory and does not need repetition or modification. Two star was taken as poor and one star as very poor and needs repetition or modification subsequently if more than 50% marked it.
There were 123 first year postgraduates who attended the programme. Majority belonged to clinical departments (87.8%) mainly General Medicine (15%), General Surgery (15%), Obstetrics and Gynaecology (8.9%) and Paediatrics (7%) (Table -1).
Day 1 pre-test and post evaluation is shown in Table 2. There were 114 (92.6%) participants and the mean pre-test score was 12.29 with a standard deviation of 4.037 and post test score was 14.92 with a standard deviation of 2.414. Test scores were normally distributed as confirmed by Kolmogorov-Smirnov test .The paired t-test value was -6.039 with p-value = 0.0001 which shows significant improvement.
TABLE 2: Day 1 Pretest & Post Test Results
|
Paired Samples Statistics |
Pair 1 |
Pre_Test_Score |
Mean |
12.29 |
||
|
N |
114 |
|||||
|
Std. Deviation |
4.037 |
|||||
|
Std. Error Mean |
0.378 |
|||||
|
Post_Test_Score |
Mean |
14.92 |
||||
|
N |
114 |
|||||
|
Std. Deviation |
2.414 |
|||||
|
Std. Error Mean |
0.226 |
|||||
|
Paired Samples Correlations |
Pair 1 |
Pre_Test_Score & Post_Test_Score |
N |
114 |
||
|
Correlation |
.024 |
|||||
|
Sig. |
0.799 |
|||||
|
Paired Samples Test |
Pair 1 |
Pre_Test_Score - Post_Test_Score |
Paired Differences |
Mean |
-2.632 |
|
|
Std. Deviation |
4.653 |
|||||
|
Std. Error Mean |
.436 |
|||||
|
95% Confidence Interval of the Difference |
Lower |
-3.495 |
||||
|
Upper |
-1.768 |
|||||
|
t |
-6.039 |
|||||
|
df |
113 |
|||||
|
Sig. (2-tailed) |
0.0001 |
|||||
One hundred and two students (82.9%) filled the pre and post test Questionnaire on Day 2. The mean pre-test score was 11.3 with a standard deviation of 4.567 and post=test score was 15.27 with a standard deviation of 1.961, the paired t-test value was -7.095 with p-value = 0.0001 .(Table 3). Figures 1 &2 represent the pre-test and post test results.
TABLE: 3 Day 2 – Pre and Post Test results T-Test
|
Paired Samples Statistics |
Pair 1 |
Pre_Test_Score |
Mean |
11.75 |
||
|
N |
102 |
|||||
|
Std. Deviation |
4.57 |
|||||
|
Std. Error Mean |
0.452 |
|||||
|
Post_Test_Score |
Mean |
15.27 |
||||
|
N |
102 |
|||||
|
Std. Deviation |
1.96 |
|||||
|
Std. Error Mean |
0.194 |
|||||
|
Paired Samples Correlations |
Pair 1 |
Pre_Test_Score & Post_Test_Score |
N |
102 |
||
|
Correlation |
-.021 |
|||||
|
Sig. |
.833 |
|||||
|
Paired Samples Test |
Pair 1 |
Pre_Test_Score - Post_Test_Score |
Paired Differences |
Mean |
-3.520 |
|
|
Std. Deviation |
5.010 |
|||||
|
Std. Error Mean |
.496 |
|||||
|
95% Confidence Interval of the Difference |
Lower |
-4.504 |
||||
|
Upper |
-2.535 |
|||||
|
t |
-7.095 |
|||||
|
df |
101 |
|||||
|
Sig. (2-tailed) |
0.0001 |
|||||
Out of 123, 85 students filled the feed back forms and the response rate was 69%. All the sessions were rated more than 3 stars . The sessions on manuscript writing, Data entry and soft ware application (SPSS) and interim analysis may need clarity as 4 to 5% rated them as 2 star and 1 star.
TABLE 4: FEEDBACK RESULTS:( N=85)
|
S. NO |
NAME OF THE SESSION |
RATING SCALE |
||||
|
5 STAR N (%) (Excellent) |
4 STAR N( %) (Very Good) |
3 STAR N (%) ( Good) |
2STAR N ( %) (Poor) |
1STAR- N ( %) (Very Poor) |
||
|
1 |
Objectives of the Programme Basics of research & Research methodology |
40 (47) |
31(36) |
14(17) |
0 |
0 |
|
2 |
Rules and Regulation as per PGMEB |
34(40) |
34(40) |
15(18) |
1(1) |
1(1) |
|
3 |
Selection of Topic for Thesis and Responsibilities |
37(44) |
29(34) |
18(21) |
1(1) |
0 |
|
4 |
Framing title of the study |
38(45) |
35(41) |
10(12) |
1(1) |
1(1) |
|
5 |
Subject recruitment for various studies. |
38(45) |
32(38) |
12(14) |
2(2) |
1(1) |
|
6 |
Conduct of Clinical trials and Research involving animals |
38(45) |
33(39) |
10(12) |
2(2) |
2(2) |
|
7 |
Protocol preparation and submission for SRC |
39(46) |
32(38) |
12(14) |
1(1) |
1(1) |
|
8 |
Elements of Informed Consent |
39(46) |
32(38) |
13(15) |
1(1) |
0 |
|
9 |
Protocol preparation and submission for IEC |
39(46) |
33(39) |
11(13) |
1(1) |
1(1) |
|
10 |
Students Presentation |
40(47) |
44(40) |
11(13) |
0 |
0 |
|
11 |
Data Entry ,Data Analysis ,Software's |
37(44) |
30(35) |
14(17) |
3(3) |
1(1) |
|
12 |
Interim Analysis: |
42(49) |
26(31) |
13(15) |
3(4) |
1(1) |
|
13 |
Writing Review of Literature |
41(48) |
26(31) |
16(19) |
1(1) |
1(1) |
|
14 |
Writing Observation/Results |
47(55) |
21(25) |
15(18) |
1(1) |
1(1) |
|
15 |
Writing Discussion and references |
43(51) |
28(33) |
12(14) |
0 |
2(2) |
|
16 |
Limitations and Strengths , Summary conclusions, Implications |
39(46) |
28(33) |
16(19) |
1(1) |
1(1) |
|
17 |
Abstract- Formats |
39(46) |
27(32) |
17(20) |
1(1) |
1(1) |
|
18 |
Bibliography-Softwares |
39(46) |
29(34) |
14(17) |
2(2) |
1(1) |
|
19 |
Writing Manuscript for Publication |
39(46) |
29(34) |
12(14) |
4(5) |
1(1) |
|
20 |
Protocol Presentation by Students |
38(45) |
33(39) |
11(13) |
1(1) |
2(2) |
The other feed back comments included that the sessions are long and the programme could be spanned over 5 days to one week and few students (5) felt that it should be conducted as a half a day programme and data analysis session needs a separate day to be dealt with.
The ultimate goal of Research methodology workshop for students is to make them understand the basics of research and its foundation and to innovate and conduct research in an ethical way which is safe to humans. To achieve this goal Institutes adopt various ways of teaching and each Institute has its own way of conducting these workshops though the content remains basically the same. Whether the teaching learning methods has made an impact is also essential to improve the efficacy of the programme. The role of pre and post test analysis of research methodology workshops in improving the research skills by Bidwe S and collegues found that there was a significant improvement in knowledge and skills about research methods and thesis writing among postgraduates and faculty. They conducted pretest prior to the programme on Day 1 using 20 questionnaire on the material to be taught during this workshop and post-test was conducted at the end of the workshop on Day 3. They have combined the scores of each test of 6 workshops and analysed the results [5]. In our study we obtained the Pre test and post-test questionnaire for each day at the end of the programme so that the knowledge gained can be fresh in their minds. In 2018, a study on feedback of postgraduate students on Research Methodology was undertaken in which among 44 students, only 13 gave feed back on Day 1, 10 on Day 2 and 10 on Day 3 [6]..They have also used pre-test and post test Questionnaire for evaluation of the Research methodology taught in the workshop and the results were analysed by ‘t’test which showed significant improvement. In the present study, feed back was taken on the same day and overall , 85 participants out of 123 gave complete feedback and response rate was 69%. Organising the content to be delivered effectively is important to evaluate its efficacy later. A study conducted in University Education Ghana, [7] for evaluating the performance of workshops, organised in to 11 sections and the evaluation was also based on the sections . In the current study we organised the programme under 20 sessions and the feed back was reported on a rating scale based on the sessions.
There are various models described in literature to evaluate research methodology workshops. Investigators from Chennai , using four levels of CIRO model for evaluating Research methodology for postgraduates reported significant increase in knowledge , instilled confidence, addressed the learners need and made them competent. The model used context , input , reaction and outcome [8].Kirk Patrick model was used to evaluate research methodology workshop for postgraduates in Kalinga Institute of Medical Sciences ,Odisha. They reported a statistically significant difference in pre- and post test scores using paited t test. The mean ± SD pretest and posttest scores at a 95% confidence interval were 10.55 ± 2.537 and 12.43 ± 2.484, respectively among 132 postgraduate students and these results are almost similar to the present study. We determined pretest and post test scores separately . On Day 1, the mean pre-test score was 12.29 ± 4.037(SD) and post test score was 14.92 ± 2.414 (SD) among 114 respondants. On Day 2, The mean pre-test score was 11.3 with a standard deviation of 4.567 and post=test score was 15.27 with a standard deviation of 1.961 among 102 respondants. The reduction in post-test standard deviation (Day 1: 4.03 → 2.41; Day 2: 4.57 → 1.96) suggests homogenization of knowledge levels among postgraduates, indicating that the workshop. Abdulghani HM and collegues evaluated 5 research methodology workshops by applying Kirk Patrick’s model. Pre and post test evaluation, feed back questionnaire were used and developmental plan reports and behavioural surveys were used to assess effectiveness involving 116 participants.They demonstrated s significant increase in knowledge and skills and the impact was 56.9% of participants starting research, and 6.9% published their research studies. Positive feedback was given by 79% of the participants [2].
A study from Arunachal Pradesh, India aimed to evaluate the impact of research methodology included both faculty and Postgraduates . The pretest and post test answers were compared using Chi-square test and test scores were compared with paired t test. There was a significant improvement in the effectiveness of research methodology workshop and the feed back regarding organisation was constructive and the feed back results rated 43% as excellent and 57 % as good [9]. In the present study, we obtained feed back for each session and more than 45% (range 45%- 55%) rated excellent for majority of sessions. A study conducted for evaluation of research methodology workshop for postgraduates in SV Medical College, Tirupati, Andhra Pradesh, graded the programme as excellent by 85%. However, the suggestions for improvement included to avoid confrontation among the speakers, to conduct the programme over 2 days rather than a single day , separate workshop for Statistical analysis, elaborate session on ethics and reference writing and the programme to be conducted with in one month of joining the course. The programme lacked the manscript writing session and Proforma for writing a protocol and for submission to ethical committee [10] . The present study received the following comments Viz: to conduct the programme only for half a day spreading across a week and separate workshop for Sample determination and Data analysis and Bibliography. Sessions on statistics and manuscript writing are inherently skill-based and benefit from hands-on teaching with exercises and examples and this needs to be addressed as we plan to conduct this session in detail once more. Our programme included protocol writing, proforma for SEC and IEC and also manuscript writing and choosing a journal for publication. After the programme , few had taken help from statisticians for sample calculation and all postgraduates could submit their thesis protocol on time.
,When Kirkpatrick's Model is applied , the 4 levels of the model was attained i.e 1. knowledge as per the pre and post test evaluation, 2. Satisfaction as per the results of feed back,3. Behavior as they could write the research protocol 4.impact on organization goals as research output , as 99% of the students submitted their thesis approval after ethical clearance on time to the university.
The Research methodology workshop was effective as it significantly improved the knowledge and skills of the postgraduate students in planning and preparing research protocols as per the ICMR guidelines as well as the Institutional Research guidelines.
The evaluation of this research methodology workshop met the key components of such method (evaluation) as it assessed the knowledge acquisition by scientific methods of pre-test and post test questionnaire. The questionnaires were prepared from the topic which was due to be delivered to meet the objectives of programme.
It was purpose driven as it aimed to prepare the students to formulate research question, hypothesis and writing the SRC and IEC protocols and data collection Data analysis and finalising the results and analyisng the limitations and strengths of the research for their thesis purpose.
The application of Kirkpatrick’s model provided a structured and comprehensive evaluation framework, supporting its wider use in postgraduate medical education. Refinement of programme duration and modularization of skill-based sessions may further enhance its educational impact.
Strengths: The programme was evaluated by applying Kirk Patricks model and modifications would be done as per the feedback
Limitations: It is a retrospective analysis and involved feedback only from students and not from faculty. A feedback from other faculty may enhance the quality of the prograamme.
Recommendations: Research methodology programmes need to be evaluated from time to time Qualitatively and Quantitatively as new methods of teaching learning methods are evoloving due to fast digitalization.
Future workshops could incorporate blended learning, hands-on statistical labs, and follow-up mentoring. Long-term evaluation metrics such as publication rates, protocol quality scores, and supervisor assessments could provide stronger evidence for Quality improvement and sustainability of the programmes.
[1] Ørngreen, R., & Levinsen, K. T. . Workshops as a Research Methodology. Electronic Journal of ELearning, 2017;15(1), 70-81. [569].
[2] Abdulghani HM, Shaik SA, Khamis N, Al-Drees AA, Irshad M, Khalil MS, Alhaqwi AI, Isnani A. Research methodology workshops evaluation using the Kirkpatrick's model: translating theory into practice. Med Teach. 2014 Apr;36 Suppl 1:S24-9. doi: 10.3109/0142159X.2014.886012. PMID: 24617780.
[3] Debata I, Nayak S, Ahmed S, Behera BK, Padhee S. Evaluating a research methodology workshop among postgraduate students using Kirkpatrick’s model. J Edu Health Promot 2024;13:88
[4] Guideline for Pre-andPost-Testing: International Training and Education Centre for Health. https://www.go2itech.org/HTML/CM08/toolkit/tools/print/tools/skills/TIG_Guidelines_Pre_Post_Test.pdf downloaded on 12th March 2025.
[5] Bidwe S, Nemade ST, Kamble CG, Power JD. Role of Research methodology workshop in improving research skills by pre test- post test analysis. Indian Journal of Basic and Applied Medical Research, September 2017: Vol.-6, Issue- 4, P. 74-77.
[6] Domple VK, Hirwarker PA, Srigiriwar MB. . Feedback of postgraduate students about Research Methodology Workshop. Int J Community Med Public Health. 2019 Jan;6(1):100-104 http://www.ijcmph.com
[7] Damalie IF, Agbanu P, Fiadzomor P, Akrong S. Evaluation, an Effective Tool for Performance Assessment of Workshops and Events towards Policy Direction in University Education in Ghana. Open Access Library Journal. 2022 Sep 30;9(10):1-1.
[8] Valarmathi S, Sivaranjani E, Sundar JS, Srinivas G, Kalpana S, et al. (2024) Evaluation of Research Methodology Workshop Using CIRO Model. J Comm Med and Pub Health Rep 5(14): https://doi.org/10.38207/JCMPHR/2024/NOV051405136.
[9] Sarkar A, Saring N, Sanyal R, Lalin D. Evaluating the impact of a research methodology workshop on medical postgraduates and faculty: A pretest-post-test analysis. Panacea J Med Sci. 2025;15(2):364-368.
[10] G. Ravi Prabhu, B. Srihari Rao, M. S. Sridhar, K. Ashok Kumar Reddy, PAS Chandrasekharan, D. Shankara Reddy, A. S. Kireeti. “Evaluation of Research Methodology Workshop for Postgraduates in A Medical College, Tirupati.” Journal of Evolution of Medical and Dental Sciences 2015; Vol. 4, Issue 93, November 19; Page: 15868-15872, DOI: 10.14260/jemds/2015/2303.
IJBMR -ISSN: 0976:6685. ©Copyright 2026 This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Published by BioMedSciDirect Publications