Human Generated Data

Title

Untitled (group of sailors standing on dock in front of ship)

Date

20th century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22212

Human Generated Data

Title

Untitled (group of sailors standing on dock in front of ship)

People

Artist: Unidentified Artist,

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.8
Human 99.8
Person 99.6
Person 99.3
Apparel 99.1
Clothing 99.1
Person 97
Person 96.2
Person 95.4
Person 95.2
Person 92.4
Sailor Suit 92.1
People 84.8
Person 84.3
Person 81.7
Stage 78.8
Crowd 77.2
Person 73
Dress 72.1
Train 72.1
Vehicle 72.1
Transportation 72.1
Female 69.2
Person 67.8
Person 66.8
Military 65.3
Face 64.9
Officer 64
Military Uniform 64
Hat 63.7
Fashion 62.3
Gown 62.3
Photo 60.5
Photography 60.5
Portrait 60.5
Person 60.3
Girl 60
Costume 59.4
Robe 59
Dance Pose 58.7
Leisure Activities 58.7
Parade 56.1

Imagga
created on 2022-03-11

people 29.5
brass 24.1
nurse 20.5
kin 20.4
man 20.1
person 20.1
couple 19.2
adult 18.3
male 18
wind instrument 18
happiness 16.4
family 16
portrait 15.5
men 15.4
musical instrument 14.3
love 14.2
winter 12.8
women 12.6
day 12.5
old 12.5
world 12.4
smiling 12.3
mother 12.1
groom 12.1
two 11.8
religion 11.6
city 11.6
bride 11.5
group 11.3
happy 11.3
travel 11.3
scene 11.2
church 11.1
child 10.5
together 10.5
outdoors 10.4
cornet 10.3
youth 10.2
life 10.2
wedding 10.1
trombone 10.1
dress 9.9
new 9.7
architecture 9.4
tourist 9.3
holiday 9.3
smile 9.3
outdoor 9.2
human 9
cheerful 8.9
building 8.6
daughter 8.6
snow 8.5
togetherness 8.5
monument 8.4
uniform 8.3
historic 8.2
holding 8.2
suit 8.1
history 8
home 8
military 7.7
crowd 7.7
married 7.7
house 7.5
religious 7.5
traditional 7.5
negative 7.4
vacation 7.4
girls 7.3
celebration 7.2
face 7.1
summer 7.1
businessman 7.1

Google
created on 2022-03-11

White 92.2
Coat 90.2
Standing 86.4
Style 83.8
Dress 83.5
Headgear 83.2
Black-and-white 82.6
Monochrome 76.6
Uniform 76.5
Suit 76.1
Monochrome photography 74.8
Snapshot 74.3
Vintage clothing 73.8
Event 73.8
Team 73.6
Crew 69.6
Formal wear 67
Classic 65.4
Stock photography 64
Ceremony 61.5

Microsoft
created on 2022-03-11

person 98
clothing 96.4
outdoor 93.7
group 88.8
wedding dress 84.8
posing 78.8
man 72.8
bride 71.9
woman 64.3
text 58.6
team 50.2
clothes 24.5

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 80%
Happy 11.8%
Surprised 3.3%
Disgusted 2.8%
Sad 0.6%
Confused 0.6%
Fear 0.6%
Angry 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Calm 85.2%
Happy 13.9%
Surprised 0.3%
Sad 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 40-48
Gender Male, 98.8%
Happy 66.5%
Calm 23.6%
Angry 5.1%
Surprised 1.3%
Disgusted 1%
Fear 0.9%
Sad 0.9%
Confused 0.6%

AWS Rekognition

Age 40-48
Gender Male, 99.5%
Happy 87.1%
Angry 3.4%
Calm 3.3%
Disgusted 2.2%
Sad 1.3%
Confused 1.2%
Surprised 1.1%
Fear 0.5%

AWS Rekognition

Age 53-61
Gender Male, 99.6%
Calm 82.9%
Confused 5.7%
Angry 5.3%
Surprised 2.5%
Happy 1.8%
Disgusted 0.9%
Sad 0.8%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Male, 90.9%
Calm 53.6%
Sad 21.5%
Happy 9.4%
Surprised 4.7%
Angry 3.4%
Fear 3.3%
Confused 3%
Disgusted 1.2%

AWS Rekognition

Age 37-45
Gender Female, 63.1%
Calm 95.2%
Happy 2.1%
Disgusted 0.9%
Surprised 0.8%
Confused 0.4%
Fear 0.3%
Sad 0.2%
Angry 0.2%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 98.4%
Surprised 0.4%
Confused 0.4%
Happy 0.3%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 95%
Happy 46.9%
Surprised 27.9%
Calm 12.7%
Disgusted 5.6%
Sad 3.9%
Angry 1.5%
Confused 1.1%
Fear 0.4%

AWS Rekognition

Age 30-40
Gender Male, 98.3%
Calm 48.8%
Happy 24.5%
Disgusted 10.6%
Sad 8.4%
Confused 4.1%
Surprised 2%
Angry 0.9%
Fear 0.6%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Calm 91.3%
Happy 5.4%
Sad 0.8%
Surprised 0.8%
Disgusted 0.7%
Confused 0.4%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 45-51
Gender Male, 96.2%
Calm 55.9%
Happy 33%
Sad 5.3%
Angry 2.3%
Fear 1.4%
Surprised 1%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Calm 82.4%
Happy 8.7%
Sad 2.9%
Confused 2.4%
Surprised 1.3%
Disgusted 0.9%
Fear 0.7%
Angry 0.7%

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Fear 55.6%
Calm 26%
Sad 8%
Disgusted 6.3%
Happy 1.4%
Angry 1.1%
Confused 0.9%
Surprised 0.7%

AWS Rekognition

Age 25-35
Gender Male, 85.4%
Calm 88.9%
Fear 5.9%
Happy 1.7%
Surprised 1%
Angry 0.8%
Sad 0.7%
Confused 0.7%
Disgusted 0.3%

AWS Rekognition

Age 37-45
Gender Male, 99.5%
Calm 90.7%
Happy 5.1%
Fear 1.2%
Angry 0.9%
Surprised 0.9%
Disgusted 0.6%
Sad 0.4%
Confused 0.2%

AWS Rekognition

Age 35-43
Gender Male, 97.1%
Happy 49.2%
Calm 26.3%
Angry 12.2%
Sad 6%
Confused 2.1%
Disgusted 1.8%
Surprised 1.2%
Fear 1.2%

AWS Rekognition

Age 33-41
Gender Male, 51.6%
Calm 73.4%
Happy 16.3%
Surprised 2.9%
Fear 2.2%
Disgusted 1.4%
Angry 1.4%
Confused 1.3%
Sad 1%

AWS Rekognition

Age 27-37
Gender Male, 94%
Calm 99.3%
Happy 0.3%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 28-38
Gender Male, 79.5%
Happy 66.6%
Calm 14.2%
Fear 9.1%
Confused 3.1%
Sad 2.4%
Angry 2.1%
Disgusted 1.5%
Surprised 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Train 72.1%

Captions

Microsoft

a group of people posing for a photo 95.8%
a group of people posing for the camera 95.7%
a group of people posing for a picture 95.6%

Text analysis

Amazon

34
32
33
3