Human Generated Data

Title

Untitled (Haitian children)
Date

c. 1995
People

Artist: Esther Pullman, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1713
Copyright

© Esther Pullman

Human Generated Data

Title

Untitled (Haitian children)

People

Artist: Esther Pullman, American 20th century

Date

c. 1995

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.9
Person 99.9
Apparel 99.7
Clothing 99.7
Shorts 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.5
Person 99.3
Person 99.2
Person 99.2
Person 99.1
Person 98.8
Shoe 97.6
Footwear 97.6
Person 94.2
Shoe 91.8
Person 91.2
Person 90
Person 90
Shoe 89.8
Shoe 89.8
Person 89.3
Person 86.6
Outdoors 83.3
Housing 82.9
Building 82.9
Shoe 80.6
Person 79.7
Shoe 76.2
People 75.5
Nature 70.1
Shoe 69.7
Vehicle 67.9
Transportation 67.9
Shoe 66.4
Urban 63.6
Person 61.1
Shoe 60.3
Crowd 60
Person 57.8
Road 57.6
Pants 57.5
Countryside 57.5
Plant 56.8
Grass 56.8
Shoe 56.8
Shoe 56.1

Imagga
created on 2022-02-26

pedestrian 29.9
sky 26.3
man 21.5
people 21.2
travel 20.4
building 18.6
male 18.5
vacation 17.2
outdoors 16.9
city 16.6
summer 16.1
old 15.3
architecture 14.9
spectator 14.8
tourist 13.7
water 13.3
group 12.9
child 12.8
innocent 12.7
landscape 12.6
sport 12.5
active 12.4
tourism 12.4
walking 12.3
men 12
day 11.8
sea 11.7
outdoor 11.5
boy 11.3
construction 11.1
beach 11.1
family 10.7
person 10.6
sand 10.5
walk 10.5
holiday 10
park 9.9
engineer 9.8
together 9.6
urban 9.6
couple 9.6
sunny 9.5
house 9.3
ocean 9.1
road 9
mountain 8.9
hiking 8.6
boat 8.5
equipment 8.4
town 8.3
leisure 8.3
structure 8.1
history 8
sun 8
job 8
culture 7.7
clouds 7.6
stone 7.6
cityscape 7.6
mother 7.5
field 7.5
senior 7.5
fun 7.5
shore 7.4
father 7.2
lifestyle 7.2
horizon 7.2
river 7.1
grass 7.1

Google
created on 2022-02-26

Cloud 96.3
Sky 95.9
Shorts 89.9
Leisure 78.5
Travel 76.1
Landscape 74.7
Event 74.4
Fun 72.9
Pole 72.5
Team 68.9
Tire 67.9
Tree 63.4
Tourism 62.1
Tradition 61.8
Village 60.1
Crowd 60.1
Public event 56.3
Child 55.6
Walking 55.2
City 54.9

Microsoft
created on 2022-02-26

sky 99.8
outdoor 99.3
person 99.2
clothing 98.7
man 93.5
footwear 91.5
boy 79.8
smile 79
group 76.4
people 72.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Male, 99.5%
Confused 31.3%
Angry 26.1%
Calm 19.8%
Sad 16.9%
Surprised 2.2%
Happy 1.6%
Fear 1.2%
Disgusted 0.9%

AWS Rekognition

Age 21-29
Gender Female, 94.4%
Sad 51.8%
Confused 35.4%
Angry 7.6%
Calm 4.2%
Disgusted 0.4%
Surprised 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 16-24
Gender Female, 99.7%
Angry 34.2%
Calm 28.1%
Sad 20.3%
Confused 15.6%
Fear 0.7%
Disgusted 0.4%
Happy 0.3%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Female, 99.4%
Angry 86.7%
Sad 4.9%
Calm 4.4%
Confused 1.4%
Fear 1.2%
Disgusted 0.8%
Surprised 0.3%
Happy 0.3%

AWS Rekognition

Age 23-33
Gender Female, 99.1%
Calm 54.4%
Angry 15.9%
Sad 9%
Confused 7%
Fear 6.1%
Happy 3.7%
Disgusted 2.5%
Surprised 1.3%

AWS Rekognition

Age 14-22
Gender Female, 99%
Confused 83.9%
Calm 10.6%
Sad 3.1%
Angry 0.8%
Happy 0.7%
Disgusted 0.6%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 6-16
Gender Female, 99.4%
Happy 99.7%
Calm 0.1%
Sad 0%
Surprised 0%
Confused 0%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Female, 91.3%
Angry 66.4%
Sad 14.1%
Confused 11.2%
Calm 5.4%
Surprised 1.7%
Fear 0.7%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 16-24
Gender Female, 97.6%
Sad 82.5%
Calm 13.4%
Confused 1.3%
Fear 1.1%
Angry 0.8%
Disgusted 0.4%
Surprised 0.3%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Female, 80.5%
Happy 99.8%
Calm 0%
Confused 0%
Sad 0%
Angry 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Female, 100%
Confused 38.8%
Calm 35.1%
Disgusted 6.9%
Happy 6%
Sad 4.4%
Fear 4.3%
Angry 2.9%
Surprised 1.6%

AWS Rekognition

Age 14-22
Gender Female, 100%
Happy 81.5%
Confused 6.6%
Sad 2.9%
Surprised 2.5%
Disgusted 1.9%
Calm 1.6%
Fear 1.5%
Angry 1.4%

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 60%
Fear 34.2%
Sad 1.8%
Calm 1.3%
Surprised 1.2%
Angry 0.8%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 6-14
Gender Male, 87.9%
Sad 64.1%
Confused 27.7%
Angry 4.7%
Calm 1.5%
Surprised 0.7%
Fear 0.6%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 16-24
Gender Female, 100%
Fear 45.1%
Calm 33.3%
Sad 15.8%
Confused 1.9%
Surprised 1.7%
Happy 1%
Angry 0.7%
Disgusted 0.4%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Sad 47.4%
Fear 31.4%
Calm 16.9%
Angry 1.4%
Surprised 1.3%
Confused 0.7%
Disgusted 0.5%
Happy 0.5%

AWS Rekognition

Age 9-17
Gender Female, 81.3%
Calm 92%
Angry 1.8%
Disgusted 1.4%
Happy 1.3%
Confused 1.2%
Sad 1%
Surprised 1%
Fear 0.4%

AWS Rekognition

Age 10-18
Gender Female, 99.7%
Happy 61.9%
Angry 16.8%
Calm 11.7%
Confused 6.1%
Fear 1.2%
Surprised 0.8%
Sad 0.7%
Disgusted 0.7%

AWS Rekognition

Age 14-22
Gender Female, 89.8%
Calm 98.2%
Confused 0.4%
Sad 0.3%
Disgusted 0.3%
Happy 0.3%
Surprised 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Male, 92.5%
Calm 83.9%
Happy 12.3%
Sad 1.4%
Angry 0.8%
Fear 0.6%
Surprised 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 18-26
Gender Female, 97%
Sad 98.2%
Calm 0.9%
Fear 0.5%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Female, 99.1%
Sad 69.1%
Calm 26.2%
Happy 1.3%
Angry 1%
Disgusted 1%
Surprised 0.9%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 6-12
Gender Male, 94.3%
Happy 99.3%
Surprised 0.1%
Angry 0.1%
Calm 0.1%
Sad 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-24
Gender Female, 58.8%
Calm 74.9%
Sad 17.3%
Angry 2%
Disgusted 1.8%
Happy 1.6%
Fear 0.9%
Confused 0.9%
Surprised 0.6%

AWS Rekognition

Age 22-30
Gender Female, 96.7%
Sad 44.8%
Confused 25.7%
Calm 12.9%
Disgusted 6.7%
Angry 6%
Fear 1.7%
Surprised 1.2%
Happy 0.9%

AWS Rekognition

Age 18-24
Gender Male, 93.8%
Calm 58.8%
Happy 18.7%
Fear 10.9%
Sad 4.8%
Disgusted 2.4%
Surprised 1.9%
Angry 1.3%
Confused 1.2%

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.9%
Shoe 97.6%

Captions

Microsoft

a group of people walking down the street 97.6%
a group of people walking down a street 97.5%
a group of people walking on a street 96.9%