Chief, Personnel Testing Division (2005 to Present)

Defense Manpower Data Center, US Department of Defense

Primary duties include the management and responsibility for technical aspects of the development, calibration and quality control of the Armed Services Vocational Aptitude Battery (ASVAB). These duties include: design development, calibration, quality control and documentation of new ASVAB forms; development and evaluation of interpretive and counselor-training materials for the DoD Student Testing Program; analyses of content, validity, and psychometric precision of the ASVAB and successor instruments used for Joint-Service applicant personnel testing or for assessment in the DoD Student Testing Program; attending and serving on Joint-Service technical committees; and advising the Office of the Under Secretary of Defense and the Services on technical issues related to the ASVAB, other Joint-Service personnel tests, and the DoD Student Testing Program. As Division Chief, directly or indirectly supervise 25 full-time Division staff members.

Program Manager, Psychometric Research  (1996 to 2005)

Defense Manpower Data Center, US Department of Defense

Duties included providing technical direction for all aspects of the development and maintenance of the Armed Services Vocational Aptitude Battery (ASVAB). Responsibilities included analyzing validity, precision, and score scale quality for CAT and P&P versions of the ASVAB; chairing Joint-Service technical committees; and advising the Office of the Assistant Secretary of Defense and Military Services on technical issues related to the ASVAB. Served as a principal analyst regarding the development of the ASVAB and other standardized predictors of success in the Military. Integrated concepts from Item Response Theory, Classical Test Theory, and theoretical statistics to improve testing methodologies. Duties included framing short and long term issues; the design of research projects to address these issues; the execution of research studies; analysis of complex data; and preparation of oral reports, written reports, journal articles, and relevant technical papers.
 

Personnel Research Psychologist (1985 to 1996)

Navy Personnel R&D Center, US Department of Navy

Duties included designing and executing research studies, monitoring data collection efforts, and designing and executing statistical analyses in the area of military aptitude testing. Duties also included representing the Navy on Joint Service Working Groups, and Chairing the Manpower Accession Policy Working Group Technical Committee which is responsible for reviewing ASVAB research and development. Principal investigator on three projects covering aspects of computerized testing and selection and classification modeling. Responsibilities included ensuring the psychometric quality of computerized testing projects and other research and development in military personnel testing. Advised and executed studies in the area of computerized adaptive testing for nonmilitary clients (Departments of Labor and Justice, and North Carolina Department of Education).
 

Senior Research Analyst (1983 to 1985)

RGI, Inc.

Work involved the evaluation of differences between a computerized adaptive ASVAB prototype and the traditional paper and pencil ASVAB. Specific areas of investigation included the evaluation of differences in validity, differences caused by medium of administration, sex differences, group differences, alternate forms reliability and differential item functioning. Duties included the design and implementation of analyses and statistical procedures, supervision of related tasks, and the evaluation and interpretation of results.
 

Research Assistant (1981 to 1983)

Model Based Measurement Laboratory, University of Illinois
 
Work involved the development and evaluation of new techniques/procedures in model based measurement. Specific research areas included differential item functioning, appropriateness measurement, parameter estimation and deliberate failure. Heavy reliance was placed on the integration of concepts from item response theory with statistical/mathematical concepts. Duties included the design, implementation, and evaluation of computer-based studies in the above areas.
 

Survey Research Analyst (1980 to 1981)

Survey Research Laboratory, University of Illinois
 
Work encompassed a wide range of survey activities. Major responsibilities involved the analysis of moderate to large survey data sets. Also provided consulting services for a large number of clients concerning the application of appropriate statistical analyses and their interpretation.