Human Generated Data

Title

Picnic at Late Stevenson House
Date

1880s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2868

Human Generated Data

Title

Picnic at Late Stevenson House

People

Artist: Unidentified Artist,

Date

1880s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2868

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Person 98.5
Person 97.1
People 96.3
Person 95.8
Person 95.5
Person 95.2
Person 94.6
Person 92.6
Person 90.4
Person 89.4
Person 86.9
Person 85.4
Person 78.3
Person 78.3
Crowd 78.1
Person 76
Person 74
Person 72.9
Family 72.4
Audience 70.6
Person 70
Stage 69.3
Person 67.9
Person 65.7
Person 61.5
Person 58.2
Person 57.8
Workshop 56.2
Indoors 55
Room 55
Person 46

Clarifai
created on 2023-10-25

people 100
group 100
many 100
group together 99.6
adult 99.6
child 98.5
woman 97.6
wear 95.7
war 95.4
man 95.2
recreation 94.2
several 93.6
military 93.5
music 92.1
administration 91.7
leader 89.2
print 89.1
soldier 84.9
facial expression 84.8
crowd 83.4

Imagga
created on 2022-01-08

kin 27.6
grunge 23.8
tricycle 23.2
vintage 21.5
old 20.9
wheeled vehicle 20.2
black 18
art 18
antique 16.7
person 15.7
man 14.2
vehicle 14.2
people 13.9
aged 13.6
texture 13.2
retro 13.1
decoration 12.2
ancient 12.1
religion 11.6
drawing 11.2
graphic 10.9
pattern 10.9
dirty 10.8
portrait 10.3
design 10.2
conveyance 10
outdoor 9.9
silhouette 9.9
sexy 9.6
architecture 9.4
light 9.3
male 9.3
lady 8.9
sepia 8.7
statue 8.6
model 8.5
adult 8.4
frame 8.3
rough 8.2
style 8.2
sport 8.1
textured 7.9
sculpture 7.8
men 7.7
tree 7.7
aging 7.7
dark 7.5
human 7.5
outdoors 7.5
church 7.4
grain 7.4
child 7.4
paint 7.2
border 7.2
color 7.2
body 7.2
love 7.1

Google
created on 2022-01-08

Photograph 94.3
Snapshot 74.3
Crew 73.9
Vintage clothing 73.3
Team 71.1
Event 70.4
Stock photography 64.8
History 61.5
Suit 59.2
Monochrome 54.5
Art 54

Microsoft
created on 2022-01-08

posing 99.9
person 99.3
outdoor 98.8
group 96.6
clothing 96.5
text 94.2
man 87
standing 86
old 81.5
drawing 63.7
people 61.8
team 47.7
crowd 1.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 98.9%
Calm 99.3%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 82.3%
Sad 7.8%
Confused 5.1%
Angry 1.9%
Surprised 1%
Fear 0.8%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 37-45
Gender Female, 99.2%
Angry 52.8%
Confused 43.6%
Sad 2.5%
Calm 0.7%
Surprised 0.2%
Disgusted 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Female, 98.5%
Calm 99.4%
Sad 0.3%
Angry 0.1%
Confused 0.1%
Surprised 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 86.9%
Sad 4.4%
Angry 4.1%
Confused 1.8%
Fear 0.8%
Disgusted 0.8%
Happy 0.6%
Surprised 0.5%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Confused 30.6%
Angry 23.5%
Calm 14.1%
Fear 12.8%
Sad 11.3%
Surprised 3.9%
Disgusted 2.4%
Happy 1.4%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Confused 66%
Calm 31.8%
Angry 1%
Sad 0.5%
Surprised 0.4%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 92.3%
Angry 2.9%
Confused 2.7%
Sad 1%
Surprised 0.4%
Disgusted 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 39-47
Gender Male, 98.7%
Calm 99.3%
Confused 0.2%
Angry 0.1%
Happy 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 99.9%
Sad 0%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Confused 78.6%
Sad 7.5%
Calm 7.2%
Disgusted 3.1%
Angry 1.5%
Fear 1.3%
Surprised 0.6%
Happy 0.2%

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Calm 48.8%
Sad 35.4%
Fear 5.9%
Angry 3.4%
Confused 2.9%
Disgusted 2%
Surprised 1.2%
Happy 0.4%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 98.2%
Confused 0.8%
Sad 0.5%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 33-41
Gender Female, 79.8%
Sad 49.4%
Angry 15.6%
Calm 11.3%
Confused 7.4%
Fear 7.2%
Surprised 5.9%
Disgusted 2.3%
Happy 1%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 94.8%
Confused 1.3%
Surprised 1.1%
Happy 0.8%
Sad 0.8%
Fear 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Calm 97.8%
Confused 1.1%
Sad 0.5%
Angry 0.3%
Surprised 0.1%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 54.2%
Confused 38.2%
Surprised 2.9%
Sad 2.5%
Angry 1%
Disgusted 0.5%
Fear 0.4%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 85.9%
Fear 9%
Sad 2.7%
Confused 0.7%
Happy 0.7%
Angry 0.4%
Disgusted 0.4%
Surprised 0.3%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Sad 29%
Confused 25.6%
Calm 19.4%
Angry 12%
Disgusted 6.7%
Fear 3.9%
Surprised 1.9%
Happy 1.5%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 99.9%
Angry 0%
Confused 0%
Surprised 0%
Happy 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 99.7%
Happy 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Female, 99.9%
Calm 91.9%
Angry 2.3%
Confused 2.2%
Sad 1.8%
Surprised 0.9%
Happy 0.4%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Female, 100%
Sad 94.7%
Confused 1.7%
Calm 1.4%
Angry 0.7%
Disgusted 0.5%
Fear 0.4%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Male, 99.6%
Calm 95.7%
Happy 3.5%
Confused 0.3%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 92.8%
Angry 2.8%
Sad 2.7%
Confused 0.5%
Surprised 0.3%
Fear 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Female, 68.5%
Calm 90.5%
Sad 8.5%
Confused 0.4%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 99.4%
Confused 0.4%
Angry 0%
Happy 0%
Surprised 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 34-42
Gender Male, 69.3%
Calm 97.4%
Happy 0.9%
Confused 0.9%
Sad 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Female, 84.9%
Calm 62.9%
Sad 31.9%
Angry 3.5%
Fear 0.7%
Confused 0.4%
Surprised 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Male, 93.7%
Calm 50.2%
Sad 33.3%
Angry 8.7%
Surprised 4.3%
Confused 1.4%
Disgusted 1.1%
Fear 0.7%
Happy 0.3%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Calm 46.6%
Confused 41.8%
Sad 8.1%
Surprised 1.3%
Angry 1%
Disgusted 0.7%
Fear 0.5%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Angry 99.7%
Calm 0.1%
Confused 0.1%
Sad 0%
Fear 0%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 99.9%
Sad 0%
Confused 0%
Angry 0%
Happy 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 95.6%
Angry 1.8%
Confused 1.1%
Happy 0.6%
Sad 0.4%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Female, 65.7%
Calm 71.7%
Fear 12.7%
Sad 5.9%
Happy 5%
Surprised 1.7%
Confused 1.4%
Angry 0.9%
Disgusted 0.7%

AWS Rekognition

Age 40-48
Gender Female, 99.9%
Angry 47.8%
Calm 34.8%
Sad 9.2%
Confused 2.2%
Surprised 1.8%
Fear 1.7%
Happy 1.3%
Disgusted 1.2%

AWS Rekognition

Age 23-31
Gender Female, 89.1%
Calm 62%
Happy 30.3%
Disgusted 2.4%
Confused 1.4%
Fear 1%
Sad 1%
Surprised 0.9%
Angry 0.9%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 41.4%
Sad 33.6%
Angry 9.6%
Confused 9.5%
Fear 3.5%
Surprised 1.1%
Disgusted 0.9%
Happy 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 63.7%
Fear 22%
Sad 6.4%
Confused 2.9%
Disgusted 2.1%
Surprised 1.5%
Angry 1%
Happy 0.4%

AWS Rekognition

Age 37-45
Gender Male, 98.5%
Calm 84.9%
Disgusted 4.8%
Sad 4.4%
Angry 1.5%
Confused 1.3%
Surprised 1.2%
Happy 0.9%
Fear 0.8%

AWS Rekognition

Age 20-28
Gender Male, 98.6%
Sad 73.9%
Calm 17.3%
Confused 3.4%
Angry 2.5%
Surprised 0.9%
Disgusted 0.8%
Fear 0.7%
Happy 0.3%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 51.1%
Sad 44.6%
Confused 1.8%
Angry 0.7%
Surprised 0.5%
Fear 0.5%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 19-27
Gender Male, 95.6%
Sad 85.7%
Calm 10.1%
Fear 1.4%
Confused 1.1%
Disgusted 0.5%
Angry 0.5%
Surprised 0.4%
Happy 0.3%

AWS Rekognition

Age 27-37
Gender Female, 99.4%
Calm 88.6%
Sad 4.1%
Surprised 3.6%
Angry 1.8%
Confused 0.7%
Disgusted 0.5%
Fear 0.4%
Happy 0.2%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 77.2%
Angry 9.9%
Confused 4.4%
Sad 2.5%
Surprised 2%
Fear 1.8%
Disgusted 1.2%
Happy 1%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 29.5%
Sad 24%
Surprised 14.8%
Angry 11.2%
Confused 8%
Fear 7.5%
Disgusted 3.8%
Happy 1.2%

AWS Rekognition

Age 23-31
Gender Male, 100%
Sad 87.1%
Calm 5.7%
Confused 3.5%
Fear 2%
Surprised 0.5%
Disgusted 0.5%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Male, 99.6%
Angry 98.1%
Calm 0.9%
Fear 0.5%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%