California Chemistry Diagnostic Test-Books Pdf

CALIFORNIA CHEMISTRY DIAGNOSTIC TEST
20 Dec 2019 | 18 views | 0 downloads | 36 Pages | 444.47 KB

Share Pdf : California Chemistry Diagnostic Test

Download and Preview : California Chemistry Diagnostic Test


Report CopyRight/DMCA Form For : California Chemistry Diagnostic Test



Transcription

Introduction, The current report provides empirical evidence to support the renewal of the California. Chemistry Diagnostic Test CCDT as a valid instrument to challenge the course prerequisite for. Chemistry 11 General Chemistry 1 at Santa Monica College. Based on the guidelines governing the full approval process set by the California Community. College Chancellor s Office CCCCO the current report document the evidence supporting the. following types of validity evidence,Chapter 1 Content Validity. Content validity measures the extent to which the CCDT items are related to the curricula of the. courses into which students are placed by the test Chemistry 10 and Chemistry 11 The findings. of the study demonstrate that CCDT is valid in terms of content. Chapter 2 Cut Score Validity, Cut score validation measure the extent to which the established cutoff score of the test for a. pass is appropriate Data measuring criterion related and consequential related validity suggest. that the cutoff score of 22 is too low With the current cutoff score 75 of students are placed. into Chemistry 11 Results from an assessment activity measuring faculty judgment on the. CCDT items and a department wide discussion were used to establish a new cut score The. findings of the study recommend raising the current cutoff score to 26. Chapter 3 Disproportionate Impact, Disproportionate impact evaluates whether the CCDT has adverse impact on different groups by. gender ethnicity race and age The findings of the study reveal that the test may have a. disproportionate impact on Black and Hispanic students Furthermore raising the cut score to 26. will disproportionately impact female Black and Hispanic students The report discusses steps. the college will take to address the adverse impact of the CCDT on these groups. Because the CCDT has been approved by the CCCCO as a commercially available second party. published test the three studies content validity cut score validity and disproportionate impact. were conducted locally Test bias and reliability was not assessed in the local study. The report begins by providing a demographic profile of Santa Monica College overview of use. of the CCDT at Santa Monica College and description of the chemistry course sequence The. procedures and findings of the validation assessments are discussed by type The report. concludes with a signed CCCCO Request for Approval form. Demographic Profile of Santa Monica College, Established in 1929 Santa Monica College serves a diverse population of over 50 000 students.
annually including a large population of international students and historically underrepresented. groups The college has one of the strongest reputations for transfer in California and transfers. the highest number of students to the University of California University of Southern California. and other four year institutions While a majority of students indicate a career or degree. educational goal 84 7 many are not prepared for the rigors of college level work. Approximately one third of students attend full time Table 1 describes the demographic and. background characteristics of credit students enrolled at the college in fall 2011. Table 1 Demographic Profile Fall 2011 N 29 977,Characteristic. Female 54 0,Ethnicity Race,Asian Pacific Islander 18 5. Hispanic 33 7,Multi Ethnicities 3 5,White 30 5,19 and younger 31 8. 20 to 24 39 4,25 to 49 25 8,Over 49 3 0,Residence Status. California 83 5,Out of State 5 9,International 10 7.
Part time 0 5 to 11 5 units 62 1,Full time 12 units 37 9. Overview of the Use of CCDT at Santa Monica College. The California Chemistry Diagnostic Test CCDT is a timed paper pencil challenge exam. assessing students skills and knowledge in introductory chemistry concepts Students who wish. to enroll directly into Chemistry 11 General Chemistry 1 and bypass Chemistry 10. Introductory General Chemistry take the CCDT to challenge the Chemistry 10 prerequisite. The test consists of 44 question items related to high school chemistry and high school. mathematics Topics and skills tested include, Math solving simple algebraic equations use of proportions and percentages solving. word problems, Chemistry elements and their properties chemical formulas concentrations of solutions. gases oxidation numbers redox reactions and the concepts of acids and bases. Students taking the CCDT are allowed 50 minutes to complete the test The number of students. taking the CCDT to challenge the course prerequisite for Chemistry 11 has been relatively small. compared to the total course enrollment in the courses average 770 course enrollments annually. between 2007 and 2010 in Chemistry 11 On average SMC administers nearly 202 CDDT tests. for 193 unique students in a calendar year Students are able to retest if they have not enrolled in. Chemistry 10 or Chemistry 11 in the past three years see Table 2. Table 2 CCDT Testing Events and Unique Students 2007 2010. 2007 2008 2009 2010 Average Yr,Testing events 210 170 196 231 201 8. Students 199 165 191 215 192 5, The current cutoff score for passing the test is 22 points of maximum 44 Approximately 75.
of testing events received passing scores on the CCDT between calendar years 2007 2010. students with passing scores were directly placed into Chemistry 11 Table 3 presents descriptive. data for CCDT scores Students with non passing scores had an average score of 17. approximately 5 points below the cutoff Students with passing scores averaged a score of 31. approximately 9 points above the cutoff The mode or most frequently reported score of 21 is. only 1 point below the cutoff this finding suggests that a lot of students are at the cusp of. passing the CCDT, Table 3 CCDT Descriptive Statistics Testing Events by Outcome 2007 2010. Outcome N Percent Mean Median Mode SD,Non passing score 202 25 0 16 95 18 21 3 58. Pass score 22 points 605 75 0 30 60 30 28 5 84,Total 807 100 0 27 19 27 28 7 99. Chemistry Course Sequence, A comprehensive chemistry curriculum is offered at Santa Monica College and includes. introductory general chemistry Chemistry 10 general chemistry Chemistry 11 12 organic. chemistry Chemistry 21 22 24 and biochemistry Chemistry 31 With the exception of. Chemistry 10 all other courses have validated prerequisites in place Students may gain access to. each of these courses by meeting the appropriate prerequisite with coursework completed at. SMC or at another college Students seeking entrance directly into the first semester of general. chemistry Chemistry 11 must demonstrate the knowledge and skills necessary for success in. the course by obtaining a passing score on the CCDT Students who do not achieve the. minimum passing score on the challenge exam are directed to enroll in Chemistry 10 In. addition students are able to enroll in Chemistry 10 without taking the CCDT. Chapter 1 Content Validity, In order to determine whether the content of the CCDT adequately align with the prerequisite.
skills knowledge necessary for success in Chemistry 11 and the exit skills knowledge of. successful Chemistry 10 students two studies were conducted Seven faculty members. responsible for teaching the courses for which the CCDT is used to place students Chemistry 10. Chemistry 11 participated in the content validation activities during the spring 2010 term The. group of faculty included four full time and three adjunct instructors three women four men. four White two Black one Asian faculty, Match between CCDT Topics and CHEM10 Exit CHEM 11 Entry Skills. The first content validation study asked instructors to rate using a binary response of yes or no. whether there is a match between the knowledge and skills purported to be measured by the. CCDT as defined in the manual and the prerequisite knowledge and skills for Chemistry 11 and. exit knowledge and skills for Chemistry 10 the prerequisite course for Chemistry 11 Instructors. completed two rating sheets one for each course Instructors were asked to engage in the rating. activity independently however a group discussion around the findings occurred after the. independent rating activity, In preparation for their review instructors were provided with a numbered list of entry and exit. skills for both courses an alpha numbered list of topics purported to be tested in the CCDT and. a rating sheet Alignment between CCDT measured skills and exit entry skills in Chemistry. 10 11 were assessed in response to the following question The column values in the table. represent the knowledge and skills measured by the CCDT The row values represent the. knowledge and skills for Chemistry 10 Chemistry 11 extracted from the official SMC course. outline of record Please rate the extent to which you believe the knowledge and skills measured. by the CCDT match the Chemistry 10 Chemistry 11 course exit entry skills Mark an X in cells. when there is a match between the knowledge and skills measured by CCDT column and the. Chemistry exit entry skill row Leave cells blanks if you believe there is no match between the. knowledge and skills measured by the CCDT column and the course exit entry skills row. The topics purported to be tested in the CCDT are listed below. A Compounds and elements compounds and chemical formulas. B States of matter gases solids liquids, C Reactions of matter calculations with chemical formulas and equations. D Structure of Matter atomic nature of matter atomic structure molecular and ionic. geometry chemical bonding, E Periodic properties periodic table introduction and trends. F Solutions concentrations and stoichiometry, G Dynamics qualitative kinetics and thermodynamics.
H Lab skills,I Mathematical skills, The Chemistry 10 and Chemistry 11 entry exit skills as defined by the official course outline of. records is described in Appendix A Chemistry 10 has 21 course exit skills Chemistry 11 has 27. course entry skills,Chemistry 10 Results, The following table describes the percentages of faculty raters out of seven who identified a. match between the CCDT skills column and the Chemistry 10 exits skills row The asterisk. identifies ratings with a majority consensus more than 50 of faculty raters identifying a. match between Chemistry 10 exit skill and CCDT topic The column to the far right describes. by Chemistry 10 exit skill the CCDT skills topic addressing the exit skill only the ratings with. 50 of faculty agreement response of yes, Table 4 Content Analysis Findings Percentage of Faculty Raters Who Found Match between. CCDT Topic and Chemistry 10 Exit Skills,CHEM CCDT Skills Measured Topic Exit Skills. 10 Exit Measured,Skills A B C D E F G H I by CCDT,1 100 29 29 14 0 29 0 71 0 A H.
2 86 0 0 29 0 0 0 29 0 A,3 0 0 71 0 0 71 14 14 71 C F I. 4 29 43 86 0 0 71 0 0 71 C F I,5 0 0 43 0 0 29 0 43 86 I. 6 14 100 14 0 14 0 0 0 14 B,7 0 0 29 0 14 0 0 57 86 H I. 8 14 14 0 71 86 0 0 0 0 D E,9 0 0 0 100 57 0 0 0 14 D E. 10 14 0 0 100 29 0 0 0 14 D,11 29 0 0 14 0 71 14 14 57 I.
12 0 14 0 0 0 0 100 29 29 G,13 14 14 14 14 14 14 14 29 14 None. 14 14 14 100 0 0 71 0 14 43 C,15 0 14 14 0 0 0 0 86 14 H. 16 0 0 0 0 0 0 0 86 14 H,17 29 0 0 0 0 14 0 86 14 H. 18 0 0 0 0 0 0 0 86 14 H,19 0 0 0 0 0 0 0 86 14 H,20 0 0 0 0 0 0 0 86 14 H. 21 0 0 14 0 0 0 0 86 86 H I, The findings suggest that all but 1 of the 21 Chemistry 10 exit skills is measured by the CCDT.
topics described in the test manual In addition all knowledge skills measured by the CCDT. aligned with at least one Chemistry 10 exit skill Chemistry 10 exit skill 13 Demonstrate a. basic understanding of the scientific method was not found to match any of the knowledge and. skills measured by the CCDT However during the discussion of the content validation faculty. members concluded that the scientific method was taught and embedded in all Chemistry. courses therefore there was sufficient evidence to suggest that there is a content match between. the exit skills in Chemistry 10 and the CCDT knowledge skills even without the CCDT directly. measuring Chemistry 10 exit skill 13,Chemistry 11 Results. Table 5 describes the percentages of faculty raters out of seven who identified a match between. the CCDT skills column and the Chemistry 11 entry skills row The asterisk identifies. ratings with a majority consensus more than 50 of faculty raters identifying a match between. Chemistry 11 prerequisite skill and CCDT topic The column to the far right describes by. Chemistry 11 entry skill the CCDT skills topic addressing the prerequisite skill only the ratings. with 50 of faculty agreement response of yes, Table 5 Content Analysis Findings Percentage of Faculty Raters Who Found Match between. CCDT Topic and Chemistry 11 Entry Skills,CHEM CCDT Skills Measured Topic Entry. 11 Entry Skills,Skills A B C D E F G H I Measured,1 0 0 14 0 0 43 29 14 100 I. 2 0 0 0 0 0 29 43 14 100 I,3 0 0 0 0 0 0 0 14 100 I.
4 0 0 0 0 0 43 14 14 100 I,5 0 0 14 0 0 14 14 14 100 I. 6 0 0 0 0 0 0 14 14 100 I,7 0 0 14 0 0 14 29 0 100 I. 8 0 14 0 0 14 0 14 14 100 I,9 0 0 0 0 0 0 0 14 100 I. 10 0 14 0 0 14 0 29 14 86 I,11 0 0 0 0 0 0 0 14 100 I. 12 0 0 0 0 0 0 0 29 100 I,13 0 0 0 0 0 14 0 14 100 I.
14 14 0 14 0 0 29 0 14 100 I,15 86 0 57 0 14 14 0 57 0 A C H. 16 71 0 14 14 0 0 0 43 0 A,17 14 14 71 0 0 71 29 29 100 C F I. 18 29 57 100 0 0 43 0 14 43 B C,19 0 0 43 0 0 43 14 43 86 I. 20 0 0 14 0 0 0 0 43 100 I,21 0 14 0 100 14 0 0 0 0 D. 22 29 29 29 29 29 29 29 57 29 H,23 14 14 86 0 0 57 14 14 71 C F I.
24 0 0 0 0 0 0 0 100 29 H,25 0 0 0 0 0 0 0 100 0 H. 26 14 0 0 0 0 0 0 100 0 H,27 0 0 0 0 0 0 0 100 0 H. There was agreement among raters that all of the 27 Chemistry 11 entry skills matched the. knowledge skills measured by the CCDT All knowledge skills measured by the CCDT aligned. with at least one Chemistry 11 entry skill except, E Period properties periodic table introduction and trends. G Dynamics qualitative kinetics and thermodynamics. The findings of the first content validation study suggest that the CCDT measures more than the. prerequisite skills for Chemistry 11 however measures all of the exit skills for Chemistry 10. Alignment between CCDT Items and Success in Chemistry 10 11. The second content validation study asked instructors to rate the level of importance of each of. the 44 items on the CCDT for successful completion of Chemistry 10 or successful acquisition of. skills taught in Chemistry 11 Instructors completed two rating sheets one for each course. Instructors were asked to engage in the rating activity independently however a group. discussion around the findings occurred after the independent rating activity. In preparation for their review instructors were provided with a numbered list of entry and exit. skills for both courses a copy of the entire 44 item CCDT instrument and a rating sheet Items. were rated in response to the following question To what extent are the academic skills or. knowledge measured by the CCDT items important for successful completion of Chemistry 10. grade C or better acquisition of the skills taught in Chemistry 11 A Likert like scale was used. to rate each item,5 Critical,4 Important,3 Moderately important. 2 Slightly important,1 Not relevant at all,Chemistry 10 Results.
The mean rating for the entire test was 4 60 SD 0 61 suggesting that overall the CCDT. measured skills and knowledge that were important for successful completion of Chemistry 10. No items on the CCDT were rated an average score below 3 or moderately important Seven of. the items had an average score of 5 or critically important A majority of the items 35 items. had an average score between 4 0 and 4 9 a rating of important The remaining two items had. an average score between 3 0 and 3 9 which indicate a rating of moderately important for. successful completion of Chemistry 10 Table 6 provides descriptive statistics for each item in. descending mean order, Table 6 CCDT Item by Item Analysis for Chemistry 10. Item N Mean SD Min Max Item N Mean SD Min Max,1 7 5 00 0 00 5 5 35 7 4 71 0 76 3 5. 2 7 5 00 0 00 5 5 40 7 4 71 0 49 4 5,5 7 5 00 0 00 5 5 42 7 4 71 0 49 4 5. 9 7 5 00 0 00 5 5 3 7 4 57 0 53 4 5,32 7 5 00 0 00 5 5 16 7 4 57 0 53 4 5. 33 7 5 00 0 00 5 5 17 7 4 57 0 53 4 5,43 7 5 00 0 00 5 5 18 7 4 57 0 53 4 5.
6 7 4 86 0 38 4 5 20 7 4 57 0 53 4 5,12 7 4 86 0 38 4 5 27 7 4 57 0 79 3 5. 13 7 4 86 0 38 4 5 8 7 4 43 0 53 4 5,19 7 4 86 0 38 4 5 24 7 4 43 0 79 3 5. 21 7 4 86 0 38 4 5 28 7 4 43 0 53 4 5,22 7 4 86 0 38 4 5 30 7 4 43 0 79 3 5. 41 7 4 86 0 38 4 5 31 7 4 43 0 53 4 5,44 7 4 86 0 38 4 5 34 7 4 43 0 79 3 5. 4 7 4 71 0 49 4 5 36 7 4 43 0 79 3 5,10 7 4 71 0 49 4 5 37 7 4 29 0 76 3 5.
11 7 4 71 0 49 4 5 7 7 4 14 0 90 3 5,15 7 4 71 0 49 4 5 25 7 4 14 0 90 3 5. 23 7 4 71 0 49 4 5 39 7 4 00 0 82 3 5,26 7 4 71 0 49 4 5 14 7 3 57 0 98 2 5. 29 7 4 71 0 49 4 5 38 7 3 57 0 53 3 4,Chemistry 11 Results. The mean rating for the entire test was 4 81 SD 0 42 suggesting that overall the CCDT. measured skills and knowledge that were important for successful acquisition of skills and. knowledge taught in Chemistry 11 No items on the CCDT were rated an average score below 4. or important Eighteen of the items had an average score of 5 or critically important which. indicate that the skills being measured by these items are critical for learning the skills the. Chemistry 11 The remaining 26 items had an average score between 4 0 and 4 9 a rating of. important Table 7 provides descriptive statistics for each item in descending mean order. Table 7 CCDT Item by Item Analysis for Chemistry 11. Item N Mean SD Min Max Item N Mean SD Min Max,1 7 5 00 0 00 5 5 19 7 4 86 0 38 4 5. 2 7 5 00 0 00 5 5 20 7 4 86 0 38 4 5,5 7 5 00 0 00 5 5 29 7 4 86 0 38 4 5.
7 7 5 00 0 00 5 5 35 7 4 86 0 38 4 5,9 7 5 00 0 00 5 5 41 7 4 86 0 38 4 5. 12 7 5 00 0 00 5 5 42 7 4 86 0 38 4 5,15 7 5 00 0 00 5 5 44 7 4 86 0 38 4 5. 16 7 5 00 0 00 5 5 3 7 4 71 0 49 4 5,21 7 5 00 0 00 5 5 8 7 4 71 0 49 4 5. 22 7 5 00 0 00 5 5 11 7 4 71 0 49 4 5,23 7 5 00 0 00 5 5 13 7 4 71 0 49 4 5. 26 7 5 00 0 00 5 5 24 7 4 71 0 49 4 5,32 7 5 00 0 00 5 5 31 7 4 71 0 49 4 5.
33 7 5 00 0 00 5 5 18 7 4 57 0 53 4 5,36 7 5 00 0 00 5 5 25 7 4 57 0 53 4 5. 37 7 5 00 0 00 5 5 27 7 4 57 0 79 3 5,40 7 5 00 0 00 5 5 28 7 4 57 0 53 4 5. 43 7 5 00 0 00 5 5 30 7 4 57 0 53 4 5,4 7 4 86 0 38 4 5 34 7 4 43 0 79 3 5. 6 7 4 86 0 38 4 5 39 7 4 43 0 79 3 5,10 7 4 86 0 38 4 5 14 7 4 29 0 49 4 5. 17 7 4 86 0 38 4 5 38 7 4 00 0 58 3 5,Summary of Content Validity.
Based on the two content validation studies the skills and knowledge being measured by the. CCDT have been deemed to be relevant to the curricula in Chemistry 10 exit skills and. Chemistry 11 prerequisite or entry skills The only problem related to content alignment is. related to one Chemistry 10 exit skill while a student completing Chemistry 10 are expected to. understand the scientific method based on the course outline of record it is not an entry skill for. Chemistry 11,Chapter 2 Cut Score Validity, Two studies a study of criterion related validity and a study of consequential related validity. were conducted to evaluate the validity of the current cut score of 22 points out of maximum. 44 Based on the findings of these studies which failed to validate the cut score a third study. assessing the faculty rating of the cut score was conducted to establish a new cut score A total. of 770 students completed the CCDT between the calendar years 2007 and 2010 however only. 542 or 70 4 enrolled in the appropriate Chemistry course based on their placement score. Table 8 provides descriptive statistics of CCDT scores of students who subsequently enrolled in. a chemistry course upon completion of the test Among students who completed the CCDT more. than once during the observed period the highest score obtained before enrollment in the first. chemistry course was recorded Only the first enrollment in the course was recorded Based on a. cutoff score of 22 approximately 82 3 of students received passing scores on the CCDT. between calendar years 2007 2010 and were directly placed into Chemistry 11 Students with. non passing scores had an average score of 17 approximately 5 points below the cutoff Students. with passing scores had an average score of 31 approximately 9 points above the cutoff. Table 8 CCDT Descriptive Statistics Testing Events by Outcome 2007 2010. Test Outcome N Percent Mean Median Mode SD,Non passing score 96 17 7 16 96 18 19 3 30. Pass score 22 points 446 82 3 30 67 30 28 5 89,Total 542 100 0 28 25 28 28 7 61. Chemistry 10 students were not included in the criterion related and consequential related. validity analyses as the CCDT functions as a challenge exam and not a placement exam. Therefore the CCDT only places students in Chemistry 11 and not Chemistry 10. Criterion Related Validity, The CCDT is used to challenge the prerequisite course Chemistry 10 in order to place directly. into Chemistry 11 Therefore the CCDT s purpose is to predict success in Chemistry 11. Criterion related validity for the CCDT is defined as the ability of the test to predict Chemistry. 11 course performance Criterion related validity was assessed by measuring the strength of the. relationship between CCDT score and three different criterion measures of student performance. related to achievement,a Course outcome successful non successful.
b Instructor ratings based on evidence observed over the first few weeks of the course. of each student s ability to learn the course content or likelihood of success and. c Mid term grades over course content, The threshold for an acceptable criterion related validity coefficient as defined by the California. Community Colleges Chancellor s Office is 35,Course Outcome. A binary logistic regression analysis was used to determine the predictive value of CCDT score. on the outcome variable success in Chemistry 11 The independent variable was the CCDT. score The dependent variable was a dichotomous variable of Chemistry 11 course performance. success grades of A B C or Credit and nonsuccess grades of D F Incomplete No credit. and Withdrawal Successful grades were coded with a 1 and non success grades were coded. with a 0 The sample of students included students who completed the CCDT and earned a. score of 22 or higher in calendar years 2007 2008 2009 and 2010 and subsequently enrolled in. Chemistry 11 by fall term 2011 Only the attempt earning the highest score prior to enrolling in a. chemistry course was recorded for students who took the CCDT more than once In addition. only the first attempt in Chemistry 11 was recorded for each student Students who earned scores. below 22 were excluded from the analyses as they were directed to enroll in Chemistry 10. Table 9 presents the results of the beta coefficient standard errors associated with the coefficient. and the unstandardized odds ratio for the logistic regression model predicting Chemistry 11. course outcome Overall the full model accurately predicted approximately 69 1 of the cases. however the accuracy rate of 69 1 is only slightly better than the rate of accuracy achievable. by chance alone 67 9 The 2 Log Likelihood for the model was 507 489 with chi square. value of 52 1 and p value of 001 was statistically significant at the 05 significance level which. indicates that overall the full model successfully predicts Chemistry 11 course outcome The. data reveal that one point increase on the CCDT increased the odds of earning a successful. Chemistry 11 grade by 14 8 Overall the analysis reveals that CCDT performance positively. predicts Chemistry 11 course outcome therefore the CCDT shows acceptable criterion related. validity on this measure, Table 9 Odds Ratios for CCDT Score on Chemistry 11 Course Outcome N 446. Variable B S E Exp B,CCDT Score 138 0 21 1 148,Note p 001. In addition to the logistic regression an independent t test was conducted to assess whether there. is a statistically significant difference in CCDT scores by Chemistry 11 course success outcome. On average the successful course completion rate of students who were placed directly into. Chemistry 11 between 2007 and 2010 was 67 9 An independent t test analysis revealed that. there was a significant difference in the mean CCDT scores for successful Chemistry 11 students. M 32 00 SD 5 89 and non successful Chemistry 11 students M 27 86 SD 4 79. t 444 7 34 p 000 see Table 10 The data reveal that on average students who were. unsuccessful in their first enrollment in Chemistry 11 earned 28 points on the CCDT 6 points. higher than the cutoff score of 22 This finding suggests that the cutoff score of 22 may be too. Table 10 Chemistry 11 Course Outcome Descriptive Statistics 2007 2010. Chemistry 11 N Percent Mean Median Mode SD,Success C or better 303 67 9 32 00 32 36 5 89.
Non success D F I,143 32 1 27 86 27 28 4 79,Total 446 100 0 30 67 30 28 5 89. Instructor Ratings, Instructor ratings of student preparedness were assessed by administering an instructor survey in. Chemistry 11 classes in the fifth weeks of spring 2010 and fall 2010 Instructors were asked to. rate the extent to which they believed each student in their Chemistry 11 class was able to learn. the course content based on their performance in the first weeks of the course Instructions. provided to faculty were For each student in your roster please rate the student s level of. preparedness for coursework in Chemistry 11 by checking the appropriate box Base your rating. on student s demonstrated skills understandings and ability to comprehend the course material. as shown in homework quizzes tests class discussion and other assignments Disregard factors. such as attendance and promptness in submitting homework assignments when making your. judgments Faculty assessed each student in their roster including students who did not complete. the CCDT in order to control for potential rater bias Therefore faculty members did not know. which students were placed into Chemistry 11 by the CCDT or completed the course. prerequisite Chemistry 10,A Likert like scale was used to rate each student. 5 Extremely well prepared,4 Well prepared,3 Adequately prepared. 2 Marginally prepared,1 Unprepared, A total of 23 class sections of Chemistry 11 were offered in spring and fall 2010 terms.
combined Instructors for 16 of the 23 sections responded to the survey Among the 637 unique. students enrolled in Chemistry 11 in spring and fall 2010 only 127 or 19 9 of students had. been placed into the course by the CCDT Instructor ratings data was collected for 66 of the 127. students A Pearson product moment correlation coefficient was computed to assess the. relationship between CCDT scores and instructor ratings of students preparedness for Chemistry. 11 There was a positive but small correlation between the two variables r 284 p 021 and. the correlation was statistically significant at the 05 significance level However the correlation. coefficient does not meet the minimum threshold set by the CCCCO of 35 The instructor. ratings as a criterion variable do not provide sufficient evidence for the criterion related. validity of the CCDT, The following table presents descriptive information related to both the CCDT scores and. instructor ratings for the sample On average Chemistry 11 students who were placed into the. course by the CCDT had a score of 30 95 SD 5 61 nearly 9 points above the cutoff score of. 22 and a faculty rating of 3 3 SD 1 13 which indicate that students were adequately prepared. Table 11 Descriptive Statistics CCDT Score Instructor Rating. Variable N Mean SD Median,CCDT Score 66 30 95 5 61 30. Instructor Rating 66 3 30 1 13 3, In addition a simple linear regression was conducted to test the predictive validity of the CCDT. score on instructor ratings of student preparedness for Chemistry 11 The analysis found that. CCDT score significantly predicted instructor ratings F 1 65 5 614 p 021 however. CCDT score only explained for 8 1 of the variance in instructor rating Similar to the. correlation analysis the regression analysis does not provide especially strong evidence for the. criterion related validity of the CCDT,Mid term Scores. In addition to Chemistry 11 course outcome and instructor ratings of student s ability to learn the. course content mid term course performance were used as a criterion variable Instructors. teaching Chemistry 11 classes in spring 2010 and fall 2010 were asked to provide midterm. grades for each enrolled in their sections Instructions provided to faculty were For each student. in your roster please record the total number of points earned in the course as of the mid point. of the semester date was provided for each term and the total points each student can possibly. earn as of the mid point of the semester The mid term grades of students included points earned. on quizzes tests and lab assignments Faculty provided mid term scores for each student on. their roster including students who did not complete the CCDT in order to control for potential. rater bias Therefore faculty members did not know which students were placed into Chemistry. 11 by the CCDT or completed the course prerequisite Chemistry 10. In order to account for varying total points assigned by instructor midterm grades were. calculated by dividing the number of points earned by the total points possible and multiplying. the dividend by 100 for a potential range of 0 to 100 A total of 23 class sections of Chemistry. 11 were offered in spring and fall 2010 terms combined Instructors for 16 of the 23 sections. responded to the survey Among the 637 unique students enrolled in Chemistry 11 in spring and. fall 2010 only 127 or 19 9 of students had been placed into the course by the CCDT Instructor. ratings data was collected for 55 of the 127 students A Pearson product moment correlation. coefficient was computed to assess the relationship between CCDT scores and Chemistry 11. mid term grades There was a positive but small correlation between the two variables r 243. p 033 and the correlation was statistically significant at the 05 significance level However. the correlation coefficient does not meet the minimum threshold set by the CCCCO of 35. Mid term grades as a criterion variable do not provide sufficient evidence for the criterion.


Related Books

Using the Properties of Exponents 6.1 - Space Math at NASA

Using the Properties of Exponents 6 1 Space Math at NASA

Using the Properties of Exponents 6.1.1. Astronomers rely on scientific notation in order to work with very large and small measurements. The rules

TVP21 Book Complete - Eskimo

TVP21 Book Complete Eskimo

The 2005 SXRD models (KDS-R50XBR1 and KDS-R60XBR1) have a Personal Computer Input (PC-IN), which connects directly to the PC 15 pin DIM connector (HD15 connector). Once connected the TV functions as a video monitor and audio output (separate Stereo Mini Plug) for the PC. There is a complete table of PC Input Signal Compatibility in the

IT Governance -TM-MBA Course- 11-2-07

IT Governance TM MBA Course 11 2 07

Select Technology and Process Solution Enablers to Improve IT Governance ... 5.0 IT Service Management (ITSM) ... Sarbanes-Oxley Template for a Manufacturing Company 3.

2005 SXRD Disassembly Manual - Eskimo

2005 SXRD Disassembly Manual Eskimo

This manual presents complete and concise step-by-step procedures for the disassembly of the chas-sis assemblies and the removal of all boards included in the 2005 SXRD chassis. As it is with any chassis disassembly or assembly process, care must be taken to remove chassis components with-out damaging the boards, wiring, or the chassis itself.

TRANSFORMING BUSINESSES. ENABLING RESULTS.

TRANSFORMING BUSINESSES ENABLING RESULTS

great products and to select, ... Service Practice SAP Industry Practice Automotive Aerospace ... i.e. no Sarbanes-Oxley (SOX) ...

CLASS: X STD NEW SYLLABUS 2019-2020 QN.NO: 7 TO 14 SUB ...

CLASS X STD NEW SYLLABUS 2019 2020 QN NO 7 TO 14 SUB

SINGULAR PLURAL Index Indices / indexes Matrix Matrices / matrixes Vertex Vertices / vertexes Appendix Appendices / appendixes X. SAME SINGULAR & PLURAL FORM PLURAL Deer Meal Meal Hair Hair Luggage Luggage Baggage Baggage Advice Advice Fish Fish Information Padasalai

Subject-Verb Agreement Lesson One: Intervening Phrases and ...

Subject Verb Agreement Lesson One Intervening Phrases and

plural plural In each sentence, draw an arrow from the pronoun to the antecedent. Then circle the correct form of the verb from the choices in parentheses. 1. The assistant principal assigns detention to students who (is, are) tardy six times. 2. Maya Angelou is an author who (use, uses) imagery most skillfully. 3. In addition, Sarah, who (is ...

Creating Perfection ~ Grammar Assistant

Creating Perfection Grammar Assistant

Creating Perfection ~ Grammar Assistant Emma Mitchell Copy Editor www.edmcreatingperfection.wordpress.com | 07561 895436 One/won Use one when referring to a single unit or thing: I have one more muffin left before the box is empty. Use won as the past tense form of the verb "to win": Shelly's team won the tournament and celebrated with ice-cream sundaes!

The Cellular Basis of Disease - web.duke.edu

The Cellular Basis of Disease web duke edu

NECROSIS Usually affects large areas of contiguous cells Control of intracellular environment is lost early Cells swell and organelles swell APOPTOSIS Usually affects scattered individual cells Control of intracellular environment maintained in early stages Cells contract . Compare and contrast Necrosis and Apoptosis.. Look at the chart.

READING LIT & INFORMATIONAL TEXT FOUNDATIONAL SKILLS ...

READING LIT amp INFORMATIONAL TEXT FOUNDATIONAL SKILLS

Comprehension Decoding Fluency Speaking and Listening Target/Academic Vocabulary Spelling Language Writing 9 Anchor Text Kamishibai Man Genre: Realistic Fiction Paired Selection The True Story of Kamishibai Genre: Informational Text Target Skill Cause and Effect Target Strategy Monitor/Clarify Second Read Skill Analyze Illustrations Vowel ...