Human Generated Data

Title

Untitled (Harvard Observatory group, California)
Date

1880s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2606

Human Generated Data

Title

Untitled (Harvard Observatory group, California)

People

Artist: Unidentified Artist,

Date

1880s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2606

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.3
Human 99.3
Person 99.2
Person 99.1
Person 99
Person 98.8
Person 98.6
Person 97.9
Person 96.5
People 95.5
Person 95.3
Person 94.1
Person 93.8
Person 93.7
Person 93.3
Person 90.5
Person 90.5
Person 89.2
Person 86.8
Person 86.5
Person 84.2
Person 82.7
Person 82.4
Person 77.9
Workshop 67.2
Family 66.4
Clothing 66.2
Apparel 66.2
Person 61.9
School 60.8
Person 53.6
Person 49.4
Person 47.8

Clarifai
created on 2023-10-25

people 99.9
group 99.3
documentary 98.3
adult 97.2
many 96.8
child 96.4
group together 96.3
scan 94.3
wear 92.6
man 91.3
boy 90.7
portrait 90.3
soldier 90.1
vintage 90.1
woman 88.8
war 88.6
sepia 87.4
sepia pigment 87.3
memory 87
art 85.6

Imagga
created on 2021-12-15

classroom 23
people 21.7
world 21.2
room 20.4
man 20.1
silhouette 19.9
old 16.7
cemetery 15.7
person 15.7
male 13.5
architecture 13.3
group 12.9
dirty 12.6
men 12
building 11.5
black 11.4
adult 11.4
travel 11.3
ancient 11.2
crowd 10.6
walking 10.4
kin 9.9
vintage 9.9
structure 9.7
sky 9.6
antique 9.5
grunge 9.4
uniform 9.3
historic 9.2
city 9.1
business 9.1
tourist 9.1
history 8.9
life 8.8
sepia 8.7
boy 8.7
art 8.5
outdoor 8.4
dark 8.3
tourism 8.2
sunset 8.1
to 8
scene 7.8
summer 7.7
culture 7.7
field 7.5
monument 7.5
clothing 7.2
aged 7.2
university 7.2
team 7.2
women 7.1
grass 7.1
paper 7
stone 7

Google
created on 2021-12-15

Suit 80.7
Tints and shades 76.9
Vintage clothing 73.3
Art 71.8
Rectangle 71.2
Font 69.9
History 68.7
Room 66.6
Crew 65.9
Visual arts 65.8
Event 64.8
Team 61.1
Family reunion 57.4
Paper product 56.4
Photographic paper 56.3
Collection 55.6

Microsoft
created on 2021-12-15

text 99.1
person 98.5
clothing 92.3
old 90.2
outdoor 85.6
standing 84.5
group 67.6
black 66
white 64.2
people 56.9
posing 53.1
picture frame 15.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 5-15
Gender Female, 75.4%
Angry 50.6%
Calm 20.1%
Disgusted 9.9%
Confused 8.1%
Sad 5.2%
Fear 3.1%
Happy 2.1%
Surprised 0.7%

AWS Rekognition

Age 39-57
Gender Male, 98%
Calm 64.1%
Happy 30.4%
Confused 1.7%
Sad 1.6%
Angry 1.1%
Disgusted 0.6%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 4-14
Gender Female, 99.2%
Disgusted 53.6%
Calm 22.4%
Sad 9.8%
Angry 5.9%
Happy 4.3%
Fear 1.7%
Confused 1.5%
Surprised 0.8%

AWS Rekognition

Age 13-23
Gender Male, 79%
Calm 94.9%
Sad 1.8%
Angry 1.3%
Happy 0.7%
Confused 0.5%
Surprised 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 36-54
Gender Male, 94.6%
Calm 79.7%
Sad 6.7%
Happy 6.7%
Disgusted 5.3%
Angry 0.6%
Confused 0.5%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 42-60
Gender Male, 94.6%
Calm 66.9%
Sad 30%
Angry 1%
Disgusted 0.7%
Happy 0.6%
Confused 0.4%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 10-20
Gender Female, 74.2%
Calm 75.7%
Angry 8.7%
Surprised 7.5%
Sad 4.4%
Fear 1.5%
Confused 1%
Happy 0.6%
Disgusted 0.5%

AWS Rekognition

Age 31-47
Gender Male, 87.2%
Calm 74.3%
Angry 18.7%
Happy 3.8%
Disgusted 1.4%
Sad 1%
Confused 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 23-37
Gender Male, 92.3%
Calm 32.1%
Sad 28.8%
Fear 27.5%
Angry 5.1%
Confused 4.2%
Surprised 1.2%
Disgusted 0.9%
Happy 0.2%

AWS Rekognition

Age 23-37
Gender Male, 87.5%
Calm 85.8%
Angry 5.5%
Fear 3.6%
Surprised 2.1%
Happy 1.9%
Sad 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 8-18
Gender Female, 63.4%
Calm 76.4%
Happy 13.5%
Sad 4.3%
Angry 1.8%
Surprised 1.4%
Disgusted 1.1%
Confused 0.9%
Fear 0.7%

AWS Rekognition

Age 41-59
Gender Male, 84.2%
Disgusted 88.4%
Happy 9.5%
Angry 1.1%
Calm 0.5%
Sad 0.2%
Confused 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 26-42
Gender Female, 63%
Disgusted 69.5%
Calm 11.8%
Angry 7.1%
Sad 4.6%
Happy 2.8%
Fear 2.2%
Confused 1.1%
Surprised 1%

AWS Rekognition

Age 40-58
Gender Male, 88%
Calm 42.7%
Angry 21.4%
Fear 11.2%
Disgusted 8.1%
Sad 7.7%
Surprised 3.8%
Happy 2.9%
Confused 2.2%

AWS Rekognition

Age 29-45
Gender Female, 79%
Calm 93.6%
Happy 2.3%
Disgusted 1.1%
Sad 1%
Angry 0.8%
Surprised 0.6%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 28-44
Gender Male, 93.4%
Calm 81.5%
Sad 6.6%
Fear 3.7%
Angry 3.5%
Confused 2.1%
Happy 1.2%
Surprised 1.1%
Disgusted 0.2%

AWS Rekognition

Age 20-32
Gender Female, 69.5%
Angry 51.6%
Calm 21.8%
Sad 15%
Happy 5%
Fear 4.5%
Confused 0.8%
Disgusted 0.8%
Surprised 0.4%

AWS Rekognition

Age 38-56
Gender Female, 56.6%
Calm 49.5%
Happy 44.6%
Disgusted 2%
Angry 1.4%
Sad 1.3%
Confused 0.7%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 33-49
Gender Male, 57.7%
Calm 48.9%
Sad 22.9%
Disgusted 20.5%
Angry 2.8%
Happy 2.4%
Fear 0.9%
Surprised 0.9%
Confused 0.7%

AWS Rekognition

Age 23-37
Gender Male, 67.7%
Angry 83.4%
Calm 9.3%
Sad 4.1%
Happy 1.2%
Disgusted 0.9%
Fear 0.5%
Confused 0.3%
Surprised 0.1%

AWS Rekognition

Age 46-64
Gender Male, 61.2%
Disgusted 36.8%
Happy 17.2%
Sad 16.1%
Fear 13.8%
Angry 8%
Calm 6.8%
Confused 0.8%
Surprised 0.4%

AWS Rekognition

Age 33-49
Gender Female, 66.5%
Calm 76.6%
Sad 19.9%
Angry 1.6%
Happy 0.8%
Confused 0.7%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 26-42
Gender Female, 80.7%
Disgusted 54.7%
Angry 11.8%
Sad 10.4%
Calm 9.4%
Surprised 5.1%
Confused 4.4%
Fear 2.4%
Happy 1.9%

AWS Rekognition

Age 27-43
Gender Female, 91.9%
Fear 47.7%
Sad 20.5%
Calm 20.5%
Happy 5.6%
Angry 4%
Surprised 0.9%
Confused 0.6%
Disgusted 0.1%

AWS Rekognition

Age 32-48
Gender Male, 89.9%
Calm 93%
Sad 1.8%
Happy 1.7%
Confused 1%
Angry 0.9%
Surprised 0.8%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 23-35
Gender Male, 53.5%
Calm 84.3%
Happy 3.4%
Disgusted 2.8%
Sad 2.4%
Confused 2%
Surprised 1.9%
Fear 1.7%
Angry 1.6%

AWS Rekognition

Age 13-23
Gender Female, 50.7%
Calm 82.3%
Sad 15.2%
Happy 1%
Angry 1%
Fear 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-16
Gender Female, 86.9%
Sad 93.2%
Angry 3.1%
Fear 2%
Calm 1.5%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 35-51
Gender Male, 53.1%
Sad 59.9%
Calm 37.8%
Happy 1.5%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Text analysis

Amazon

10
lifornia
in lifornia
in

Google

California 10
California
10