Human Generated Data

Title

Untitled (class portrait of students outside)
Date

1952
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21555

Human Generated Data

Title

Untitled (class portrait of students outside)

People

Artist: John Howell, American active 1930s-1960s

Date

1952

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21555

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 98.7
Human 98.7
Person 98.4
Person 98
Person 97.9
Person 95.4
Tie 91.7
Accessories 91.7
Accessory 91.7
Person 91.7
Clothing 90.9
Apparel 90.9
Vegetation 90.3
Plant 90.3
Person 88.6
People 88.1
Person 88
Person 87.3
Tree 86.6
Person 83.6
Person 83.4
Outdoors 82.2
Person 79.9
Meal 78.2
Food 78.2
Grass 78.2
Person 77
Crowd 76.8
Person 76.4
Person 75.8
Person 75.3
Shorts 70.8
Female 69.9
Person 66.1
Girl 64.4
Person 63.9
Chair 63
Furniture 63
Kid 61.8
Child 61.8
Person 61.3
Face 60.1
Nature 57.7
Picnic 57.4
Vacation 57.4
Leisure Activities 57.4
Person 57
Audience 56.6
Tie 51.1
Person 50.6
Person 48.8
Person 43.8
Person 43
Person 42.1

Clarifai
created on 2023-10-22

people 100
many 99.5
group 98.6
adult 98.2
child 97.8
man 94.6
education 93.2
crowd 92.6
school 89.1
monochrome 87.9
woman 87.8
position 86.1
group together 84.5
kneeling 84.2
wear 84
administration 82.8
leader 82.2
art 81.1
boy 77
conformity 76.1

Imagga
created on 2022-03-05

runner 38.5
athlete 32.3
contestant 21.7
structure 20.7
fountain 18.1
park 16.5
person 15.8
old 15.3
grunge 15.3
outdoors 15.2
people 15
tree 13.2
man 12.8
landscape 12.6
vintage 12.4
building 12.3
travel 12
outdoor 11.5
water 11.3
wall 10.7
decoration 10.5
antique 10.4
sport 10.2
dark 10
dirty 9.9
male 9.9
texture 9.7
forest 9.6
grass 9.5
art 9.3
city 9.1
retro 9
summer 9
surface 8.8
urban 8.7
pedestrian 8.7
light 8.7
run 8.7
field 8.4
tourist 8.3
aged 8.1
graffito 8.1
group 8.1
snow 7.8
ancient 7.8
space 7.7
crowd 7.7
sky 7.6
pattern 7.5
spectator 7.5
silhouette 7.4
vacation 7.4
design 7.3
effect 7.3
school 7.3
trees 7.1
sand 7.1
animal 7.1
day 7.1
world 7
textured 7

Google
created on 2022-03-05

Tree 82.5
Adaptation 79.3
Font 71.6
Monochrome 68.5
Monochrome photography 67.8
Event 66.3
Grass 65.7
Team 65.6
History 64.3
Stock photography 63
Plant 57
Art 56.1
Visual arts 55
Class 53.7
Room 53.5
Vintage clothing 53.4
Sitting 50.5

Microsoft
created on 2022-03-05

outdoor 94.5
person 88.2
tree 85.2
text 79.7
playground 71
clothing 70.3
group 62.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 99.4%
Happy 57.4%
Calm 42.1%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 51-59
Gender Male, 94.7%
Happy 47.5%
Calm 26.6%
Sad 18.4%
Surprised 2.3%
Disgusted 1.7%
Angry 1.4%
Fear 1.1%
Confused 1%

AWS Rekognition

Age 33-41
Gender Female, 72.3%
Happy 97.6%
Calm 1.4%
Surprised 0.6%
Fear 0.2%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 97.6%
Calm 70%
Happy 14.2%
Surprised 5.7%
Fear 3.6%
Disgusted 3.1%
Sad 1.3%
Confused 1.3%
Angry 0.9%

AWS Rekognition

Age 33-41
Gender Male, 94.3%
Surprised 49.9%
Happy 41.6%
Fear 6%
Calm 1.5%
Disgusted 0.4%
Sad 0.2%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 65.5%
Calm 56.5%
Happy 40%
Surprised 1.1%
Sad 1%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 40-48
Gender Female, 60%
Happy 98.7%
Calm 0.7%
Surprised 0.2%
Sad 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 25-35
Gender Male, 79.6%
Happy 85.5%
Calm 9.3%
Sad 1.7%
Fear 1.3%
Surprised 1.3%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 51-59
Gender Female, 88.9%
Happy 86%
Calm 9.5%
Confused 1.1%
Sad 1%
Fear 0.9%
Disgusted 0.7%
Surprised 0.5%
Angry 0.4%

AWS Rekognition

Age 30-40
Gender Male, 76.2%
Happy 98.8%
Sad 0.9%
Calm 0.1%
Fear 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 48-56
Gender Female, 80.4%
Happy 83.1%
Calm 16.4%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 88%
Happy 88.6%
Calm 9.7%
Sad 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.2%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 42-50
Gender Female, 94.1%
Calm 99%
Sad 0.3%
Happy 0.3%
Confused 0.2%
Surprised 0.1%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 55.9%
Happy 52.2%
Calm 20.5%
Surprised 12%
Sad 9.6%
Fear 2%
Confused 2%
Disgusted 0.8%
Angry 0.8%

AWS Rekognition

Age 33-41
Gender Male, 76.9%
Calm 92.9%
Happy 5.5%
Sad 0.7%
Confused 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 73.2%
Happy 54.6%
Calm 37.1%
Sad 3%
Surprised 2.8%
Fear 1.2%
Disgusted 0.6%
Angry 0.4%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Male, 94%
Calm 72.5%
Happy 24.7%
Sad 2%
Surprised 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 35-43
Gender Male, 96.7%
Happy 44.2%
Calm 19.8%
Confused 15.9%
Sad 11%
Surprised 3.4%
Angry 2.2%
Disgusted 1.9%
Fear 1.6%

AWS Rekognition

Age 48-54
Gender Female, 76.2%
Calm 87.1%
Happy 8.1%
Surprised 2.5%
Confused 1%
Angry 0.5%
Disgusted 0.4%
Fear 0.3%
Sad 0.2%

AWS Rekognition

Age 33-41
Gender Male, 97.8%
Calm 79.4%
Happy 18.6%
Surprised 1.6%
Disgusted 0.2%
Confused 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 52.5%
Calm 89.4%
Sad 6.4%
Happy 1.9%
Confused 1%
Angry 0.4%
Surprised 0.4%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.5%
Calm 94.5%
Happy 3.1%
Sad 1.6%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 40-48
Gender Female, 98%
Happy 93%
Calm 3.4%
Surprised 1.4%
Fear 1%
Sad 0.6%
Disgusted 0.2%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Male, 91.9%
Calm 79%
Happy 14.1%
Sad 3.8%
Confused 1.1%
Surprised 0.8%
Angry 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Male, 96.3%
Happy 80.9%
Sad 5.9%
Calm 4.4%
Surprised 3.9%
Fear 2%
Confused 1.8%
Disgusted 0.6%
Angry 0.5%

AWS Rekognition

Age 43-51
Gender Male, 61.6%
Calm 48.6%
Happy 48.3%
Surprised 1.8%
Fear 0.4%
Sad 0.3%
Disgusted 0.3%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Female, 96.5%
Happy 92.5%
Calm 5.9%
Surprised 0.7%
Fear 0.3%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 98.7%
Person 98.4%
Person 98%
Person 97.9%
Person 95.4%
Person 91.7%
Person 88.6%
Person 88%
Person 87.3%
Person 83.6%
Person 83.4%
Person 79.9%
Person 77%
Person 76.4%
Person 75.8%
Person 75.3%
Person 66.1%
Person 63.9%
Person 61.3%
Person 57%
Person 50.6%
Person 48.8%
Person 43.8%
Person 43%
Person 42.1%
Tie 91.7%
Tie 51.1%

Categories

Imagga

streetview architecture 68.5%
paintings art 17.2%
nature landscape 9.6%
beaches seaside 2.8%

Text analysis

Amazon

in
KODAKS
TO