Colored Pencil Comparison Test
Marc Friedlander Originally written: 10/7/2019 - Updated Last: 10/8/2019
Pencil Drawings
Description This is a test to determine the differences, if any, between 3 different brands of Colored Pencils (CPs).
Each brand has it's own price and that will be evaluated after all the data is collected, to determine if there is any correlation between price and performance.
Price is an important metric, as the price of CPs varies from slight to enormous (relatively speaking).
The test will be as unbiased as possible.
The tester won't know which brand of CP he is testing, as any distintive markings will be masked with tape.
All the pencils are round so there is no way to know which is which, except for color.
4 basic colors of each brand will be tested - Red, Blue, Yellow, and Black
The tester will select as close as possible from each pack of pencils.
The pencils to be tested are:
Prismacolor Premium
Prismacolor Scholar
Crayola
These are the brands are to be tested because these are the ones I have on hand now.
Aim
To determine if there are differences in Colored Pencil brands, and if the cost of colored pencils is corrolated with their performance
Materials
Pencils
Four colors of 3 different brands of pencils to be tested:
Prismacolor Premium
Prismacolor Scholar
Crayola
 
Test Paper Canson Bristol 96lb 260 g
Surface Paper to be mounted on Plywood work board with tape
Tape Frogtape Delicate Surface
Sharpener Carl Angel-5 manual mechanical sharpener
Performance
To be determined by CPT tests that each Pencil will perform (CPT=Colored Pencil Test).
Performance to be scored from 1-5.
Preparation
Tester to sort pencils into Red, Yellow, Blue, and Black color groups.
Tester to use masking tape to conceal any distinctive markings on the pencils.
Tester to pick from each group, one by one, while not looking at which he is picking.
When picking, tester to know which color group each pencil is in, but not the brand.
Tester to mark each pencil as follows, as he picks them:
BK1, BK2, BK3, BK4 for the 4 black pencils.  
The other color groups are RD, YL and BL.  
Test paper to be prepared in advance to designate an area for each CPT.
Tester to mount test paper on work board, using tape.
Test Paper This will have the specimens, which are the lines, circles, and squares drawn in the CPTs.
The Test Paper will be prepared to indicate each CPT and where the specimen should be drawn.
Testing The tester will create the specimen on the test paper with each pencil.
The pencils are masked with tape to conceal their brand.
The tester will complete each CPT with each pencil before moving to the next CPT.
Resharpening of the pencils as needed is allowed.  
Other than a ruler in CPT1, the specimens will be drawn freehand, within the area designated on the test paper.
  The tester will attempt to create the best specimen possible with every trial.
  Use of eraser is not allowed. Mistakes will appear on the Test Paper as drawn.
  Use of side paper for practice is allowed at any time.
 
Pre Scoring Prior to scoring the specimens, they should be cut off the Test Paper.
  Now each specimen will be alone - this is to prevent bias on the part of the judges, who may be influenced by their position on the Test Card.
  The code of each (eg CPT1-BK1) should be written lightly on the back side with pencil, to maintain the indentity of each.
 
Scoring Each specimen will be drawn randomly, and given a score from 1-5, rating the Pencil's performance on the CPT.
A score of 5 is the best, while a score of 1 is the worst.  A score of 0 means the score is N/A.
This is subjective and more judges are desirable, especially judges who did not draw the specimens.
Criteria Specimans should be judged on color depth and appearance.
Any white spots or incomplete coverage should be noted and the score should be reduced.
No reduction in score for irregular squares (going outside the lines on the Test Paper).
Score should reflect overall "satisfaction" with the specimen.
CPTs These are the tests that each pencil will undergo:
1 Straight ruled line
2 Evenly filled square - medium pressure  
3 Evenly filled square - hard pressure  
4 Gradient - fill square from light to dark  
5 Layering - lay down solid layer of a base color (Yellow), then a layer of 2nd color (Blue)on top, using variable pressure on 2nd layer.  
6 Subjective experience of using the pencil, inluding sharpening, feel - all "experiential" sensations, apart from the resultant color on the Test Paper  
     
Data    
  Once all the specimens are completed on the test paper, each specimen will be judged as described above, and assigned a numeric score from 1-5. A score of 0 indicates the CPT could not be completed, for whatever reason.  
 

The masking tape will then be removed, relealing the brand of pencil for the first time. The scores from the judge(s) can then be assigned to the brands of pencils. The data will then be collected and subjected to statistical tests as I am able to perform them. Even without statistical significance, the data may reveal something to us.

 
  The more data I have the better, however that is limited to what I am able to do myself here, and the time I'm willing to devote to this project.  
  The more judges I have, also makes it better. That is another way of getting more data. There is no limit to the number of judges that can participate.  
  Once a certain point is reached, though, the judgeship will be closed, to prevent bias. Not like millions of people will suddenly want to be judges in the great  
  Colored Pencil Comparison Test, but you never know!  
     
Notes I realize my skill with pencils is highly influential in this experiment, however, my skill is not likely to increase or decrease appreciably in the short time it takes to create the  
  specimens. All I can state is I'll do my best to create the best specimens I can, not knowing the brand of pencil.