Human Generated Data

Title

Untitled (Greek orphans aboard ship looking out to sea)
Date

1948
People

Artist: David Seymour, Polish 1911 - 1956
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Stephen Nicholas, P2004.22

Human Generated Data

Title

Untitled (Greek orphans aboard ship looking out to sea)

People

Artist: David Seymour, Polish 1911 - 1956

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Stephen Nicholas, P2004.22

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Audience 99.3
Crowd 99.3
Human 99.3
Person 96.8
Person 90.1
Parade 83.7
Person 81.7
Person 77.1
People 76.2
Military 74.7
Person 71.9
Person 71.3
Person 67.7
Waterfront 57.4
Water 57.4
Person 50

Clarifai
created on 2023-10-26

many 100
people 100
crowd 99.8
group 99.7
group together 99.5
adult 98
man 97.6
administration 96.8
war 96.5
leader 95.7
woman 93.6
military 93.3
spectator 93
soldier 86.6
vehicle 85.1
skirmish 82.5
audience 79.1
funeral 78
revolution 77.7
ceremony 77.2

Imagga
created on 2022-01-23

spectator 37.1
city 27.4
military uniform 23.8
classroom 21
uniform 19.3
travel 19
architecture 17.9
cityscape 17
buildings 16.1
room 15.9
landscape 15.6
building 15.5
skyline 15.2
crowd 14.4
silhouette 14.1
sky 14
clothing 14
covering 13.8
urban 12.2
group 12.1
pedestrian 11.8
people 11.7
structure 11.2
aerial 10.7
men 10.3
ocean 9.9
sunset 9.9
skyscrapers 9.8
old 9.7
business 9.7
consumer goods 9.6
downtown 9.6
rock 9.5
scene 9.5
sea 9.4
grunge 9.4
town 9.3
tourism 9.1
texture 9
design 9
tower 8.9
new 8.9
women 8.7
water 8.7
black 8.6
art 8.5
tree 8.5
vacation 8.2
scenery 8.1
coast 8.1
person 8.1
wall 7.7
stone 7.6
pattern 7.5
plants 7.4
park 7.4
shoe shop 7.3
office 7.2
chandelier 7.1
summer 7.1
skyscraper 7

Google
created on 2022-01-23

Photograph 94.2
Water 86.9
Crew 78.4
Crowd 77.8
Snapshot 74.3
Team 69.3
Event 68.1
Monochrome 67.2
Stock photography 64.6
Sky 64.3
Ship 64.1
History 63.7
Suit 63.2
Monochrome photography 60.4
Naval architecture 59.6
Font 56.9
Art 51.3

Microsoft
created on 2022-01-23

person 99.9
outdoor 96.3
ship 95.3
posing 94
black 93.9
group 93.5
standing 92.7
crowd 86.6
white 85.7
people 82.9
water 72.6
beach 60
black and white 54.6
auditorium 29.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 84.1%
Sad 55.4%
Angry 33.8%
Calm 9.3%
Confused 0.7%
Fear 0.3%
Disgusted 0.2%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 20-28
Gender Female, 98.7%
Sad 89.3%
Calm 9.2%
Confused 1%
Angry 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99.8%
Calm 81.3%
Sad 13.9%
Happy 2.2%
Fear 1%
Angry 0.8%
Disgusted 0.4%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Sad 40.8%
Calm 32.3%
Confused 19.2%
Angry 3.2%
Disgusted 1.7%
Fear 1.4%
Surprised 1.1%
Happy 0.3%

AWS Rekognition

Age 26-36
Gender Female, 93.7%
Fear 48.5%
Confused 22.1%
Surprised 11.3%
Angry 6.4%
Sad 5.4%
Disgusted 2.9%
Calm 2.4%
Happy 1.1%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Calm 92.3%
Confused 2.3%
Happy 2.2%
Sad 1.3%
Disgusted 0.6%
Angry 0.5%
Surprised 0.5%
Fear 0.2%

AWS Rekognition

Age 10-18
Gender Male, 82.8%
Sad 92.3%
Calm 5.6%
Fear 0.8%
Confused 0.5%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99%
Sad 41.6%
Calm 40.9%
Confused 8.8%
Happy 2.8%
Surprised 2.1%
Angry 1.4%
Disgusted 1.3%
Fear 1.1%

AWS Rekognition

Age 20-28
Gender Female, 97.8%
Sad 82.5%
Fear 16.1%
Calm 0.6%
Angry 0.4%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.3%
Sad 99.9%
Calm 0%
Angry 0%
Fear 0%
Happy 0%
Disgusted 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 9-17
Gender Male, 89.7%
Sad 70.9%
Fear 26.1%
Confused 1.6%
Calm 0.5%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Male, 56.4%
Sad 81.4%
Calm 12%
Angry 4.3%
Fear 0.8%
Confused 0.7%
Disgusted 0.3%
Surprised 0.3%
Happy 0.2%

AWS Rekognition

Age 2-10
Gender Female, 96.9%
Calm 84.7%
Happy 4.5%
Angry 2.9%
Fear 2.4%
Confused 2.1%
Sad 1.6%
Surprised 1.4%
Disgusted 0.6%

AWS Rekognition

Age 13-21
Gender Female, 99.8%
Sad 99.9%
Calm 0%
Fear 0%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 22-30
Gender Male, 62.6%
Calm 85.2%
Happy 6.1%
Sad 3.2%
Fear 1.6%
Angry 1.6%
Disgusted 0.9%
Confused 0.8%
Surprised 0.6%

AWS Rekognition

Age 23-33
Gender Female, 94.9%
Sad 87.4%
Calm 5.7%
Angry 2.8%
Disgusted 1.7%
Fear 1.1%
Confused 0.7%
Surprised 0.4%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Female, 82.7%
Calm 99.7%
Sad 0.2%
Happy 0.1%
Surprised 0%
Confused 0%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Female, 58.5%
Calm 70.2%
Fear 23.2%
Sad 3.4%
Confused 0.9%
Angry 0.8%
Surprised 0.8%
Happy 0.5%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Male, 78%
Calm 53.5%
Sad 20.3%
Angry 12.9%
Surprised 7%
Fear 2.7%
Disgusted 1.7%
Confused 1.5%
Happy 0.4%

AWS Rekognition

Age 20-28
Gender Male, 96.6%
Sad 75.1%
Calm 10.3%
Confused 4.8%
Angry 2.9%
Fear 2.8%
Happy 2.3%
Disgusted 1%
Surprised 0.8%

AWS Rekognition

Age 16-24
Gender Male, 100%
Happy 92.7%
Sad 1.7%
Angry 1.6%
Disgusted 1%
Calm 1%
Confused 0.9%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 19-27
Gender Female, 99.7%
Fear 59.9%
Calm 20.3%
Sad 10.8%
Surprised 2.3%
Happy 2.2%
Angry 2.1%
Confused 1.3%
Disgusted 1.1%

AWS Rekognition

Age 29-39
Gender Male, 50.8%
Angry 47.7%
Sad 33.7%
Calm 7.1%
Disgusted 4.8%
Happy 2.3%
Surprised 2.1%
Fear 1.9%
Confused 0.6%

AWS Rekognition

Age 30-40
Gender Male, 98.1%
Calm 83.1%
Fear 4.5%
Sad 3.4%
Surprised 2.7%
Angry 2.4%
Disgusted 2.2%
Confused 0.9%
Happy 0.8%

AWS Rekognition

Age 33-41
Gender Male, 98.9%
Calm 88.5%
Sad 9.2%
Angry 0.7%
Surprised 0.5%
Confused 0.3%
Happy 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Female, 54.6%
Sad 77.2%
Fear 10.2%
Happy 7.1%
Angry 1.9%
Calm 1.4%
Surprised 1.1%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 30-40
Gender Male, 95.9%
Sad 83.6%
Calm 13.6%
Disgusted 1%
Angry 0.9%
Confused 0.3%
Fear 0.2%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 30-40
Gender Male, 71.3%
Calm 57.2%
Sad 36.4%
Angry 3.6%
Fear 2.1%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 89.7%
Happy 73.6%
Sad 10.7%
Disgusted 8.8%
Angry 1.9%
Fear 1.9%
Surprised 1.6%
Calm 0.8%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Male, 97.4%
Calm 57.7%
Happy 32.9%
Sad 4.5%
Fear 2.2%
Disgusted 1%
Angry 0.7%
Surprised 0.6%
Confused 0.3%

AWS Rekognition

Age 7-17
Gender Male, 96.6%
Sad 40.9%
Angry 26.9%
Calm 17.4%
Fear 13.1%
Disgusted 0.6%
Surprised 0.5%
Happy 0.4%
Confused 0.3%

AWS Rekognition

Age 16-22
Gender Female, 93.1%
Calm 80.3%
Sad 12.1%
Happy 2.7%
Surprised 1.2%
Fear 1.2%
Angry 1%
Disgusted 0.8%
Confused 0.7%

AWS Rekognition

Age 4-10
Gender Female, 60.5%
Angry 47.1%
Calm 35.9%
Fear 6.6%
Happy 4.6%
Sad 3.2%
Surprised 1.3%
Disgusted 0.7%
Confused 0.7%

AWS Rekognition

Age 30-40
Gender Female, 99.5%
Calm 74.6%
Angry 18.9%
Sad 2.8%
Happy 1.4%
Disgusted 0.9%
Surprised 0.5%
Confused 0.5%
Fear 0.5%

AWS Rekognition

Age 22-30
Gender Female, 99%
Sad 92.3%
Calm 4.3%
Fear 1.1%
Happy 0.6%
Confused 0.5%
Angry 0.4%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Male, 94.7%
Sad 96.5%
Calm 2.7%
Fear 0.3%
Angry 0.3%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 4-10
Gender Female, 54.6%
Fear 49.3%
Angry 24.5%
Calm 7.4%
Confused 5.6%
Disgusted 5.2%
Sad 3.5%
Surprised 3.4%
Happy 1.1%

AWS Rekognition

Age 4-12
Gender Female, 97.9%
Fear 50.9%
Happy 29.8%
Sad 8.3%
Calm 7.7%
Surprised 1.1%
Angry 0.8%
Disgusted 0.8%
Confused 0.6%

AWS Rekognition

Age 10-18
Gender Male, 74.8%
Disgusted 41.5%
Angry 27.2%
Sad 10.8%
Calm 7.1%
Happy 6%
Fear 3%
Confused 2.6%
Surprised 1.9%

AWS Rekognition

Age 20-28
Gender Male, 99.3%
Calm 95.7%
Sad 2.9%
Confused 0.4%
Angry 0.2%
Fear 0.2%
Happy 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 4-12
Gender Male, 98.8%
Sad 31%
Angry 28.6%
Calm 18.4%
Confused 8.9%
Happy 5.1%
Fear 4.1%
Disgusted 2.3%
Surprised 1.6%

AWS Rekognition

Age 35-43
Gender Female, 55%
Happy 51.7%
Calm 30.2%
Sad 11.2%
Confused 4%
Fear 1%
Angry 0.9%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 38-46
Gender Male, 94.1%
Angry 84%
Sad 13.3%
Confused 1.6%
Calm 0.3%
Fear 0.3%
Disgusted 0.2%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 52.8%
Sad 99.6%
Fear 0.1%
Confused 0.1%
Surprised 0.1%
Calm 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 6-16
Gender Male, 96.5%
Calm 78%
Fear 11.2%
Angry 3.8%
Sad 3.5%
Disgusted 1.1%
Confused 1%
Surprised 0.9%
Happy 0.6%

AWS Rekognition

Age 21-29
Gender Male, 97.9%
Sad 26%
Calm 19.7%
Happy 19.5%
Fear 11.9%
Angry 7.7%
Disgusted 5.4%
Confused 5.4%
Surprised 4.5%

AWS Rekognition

Age 23-31
Gender Male, 96.5%
Calm 98.7%
Sad 0.7%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Female, 79.2%
Sad 93.5%
Angry 3%
Fear 1.9%
Happy 0.8%
Calm 0.5%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Female, 82.9%
Happy 83.2%
Fear 4.9%
Calm 3.1%
Sad 2.6%
Disgusted 2.4%
Angry 2.2%
Surprised 1.2%
Confused 0.4%

AWS Rekognition

Age 13-21
Gender Male, 86.4%
Calm 57.5%
Angry 13.6%
Sad 8.6%
Surprised 5.7%
Confused 4.7%
Happy 4.4%
Fear 3.5%
Disgusted 2.1%

AWS Rekognition

Age 12-20
Gender Male, 99.1%
Happy 75.4%
Sad 7.1%
Calm 6.5%
Disgusted 5.4%
Angry 3.1%
Fear 1.2%
Surprised 1%
Confused 0.4%

AWS Rekognition

Age 22-30
Gender Female, 61.5%
Angry 55.8%
Sad 39.1%
Calm 3.3%
Happy 0.7%
Confused 0.3%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 96.8%
Person 90.1%
Person 81.7%
Person 77.1%
Person 71.9%
Person 71.3%
Person 67.7%
Person 50%