Human Generated Data

Title

New York

Date

1998

People

Artist: Gerard Castello Lopes, Portuguese 1925 - 2011

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.1440

Human Generated Data

Title

New York

People

Artist: Gerard Castello Lopes, Portuguese 1925 - 2011

Date

1998

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.5
Person 98.4
Person 98.2
Sport 98.2
Sports 98.2
Person 98
Skating 97.8
Person 97.7
Person 97.6
Person 97.6
Ice Skating 97.6
Person 97.5
Person 94.6
Person 90.9
Rink 88.6
Person 86.1
Person 53.1

Imagga
created on 2022-01-22

dance 31.4
silhouette 28.1
art 23.1
crowd 21.1
people 20.6
group 19.3
creation 17.9
black 17.6
landscape 17.1
ski slope 16.6
grunge 16.2
sport 15.5
slope 15.2
silhouettes 14.5
world 14.3
men 13.7
man 13.4
travel 13.4
lake 13.3
skate 13.2
snow 13.1
male 12.1
forest 11.3
design 11.2
graphic 10.9
park 10.7
trees 10.7
walking 10.4
texture 10.4
geological formation 10.3
tree 10.2
winter 10.2
person 10
mountain 9.9
recreation 9.9
ice 9.6
couple 9.6
outdoors 9.6
sky 9.6
map 9.3
wallpaper 9.2
outdoor 9.2
vintage 9.1
old 9.1
paint 9
aged 9
scenery 9
digital 8.9
scene 8.6
cold 8.6
walk 8.6
active 8.4
stage 8.4
summer 8.4
action 8.3
national 8.1
team 8.1
sun 8
body 8
women 7.9
line 7.9
holiday 7.9
pattern 7.5
friends 7.5
ocean 7.5
earth 7.4
boy 7.4
mountains 7.4
environment 7.4
land 7.4
water 7.3
global 7.3
dirty 7.2
sea 7.2
river 7.1
season 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 97.3
snow 95
person 90
black and white 84
tree 72.1
skiing 62.5

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 99.5%
Angry 40.1%
Disgusted 19.5%
Sad 11.4%
Confused 10.2%
Calm 7.4%
Happy 6.9%
Fear 2.9%
Surprised 1.7%

AWS Rekognition

Age 20-28
Gender Male, 96.4%
Calm 41.6%
Angry 23.4%
Fear 7.7%
Happy 7.4%
Sad 5.7%
Surprised 4.8%
Disgusted 4.7%
Confused 4.6%

AWS Rekognition

Age 14-22
Gender Female, 82.8%
Calm 97.2%
Sad 1.5%
Angry 0.7%
Confused 0.3%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 27-37
Gender Male, 97.1%
Calm 70%
Sad 17.9%
Happy 4.2%
Disgusted 2.3%
Fear 1.7%
Confused 1.6%
Surprised 1.3%
Angry 0.9%

AWS Rekognition

Age 13-21
Gender Male, 82.1%
Calm 64.7%
Happy 23.5%
Fear 5.9%
Sad 2.6%
Angry 2%
Disgusted 0.5%
Confused 0.4%
Surprised 0.4%

AWS Rekognition

Age 20-28
Gender Male, 63.4%
Sad 39.4%
Fear 25.4%
Disgusted 14.6%
Calm 9.4%
Surprised 3.8%
Confused 2.5%
Happy 2.4%
Angry 2.4%

AWS Rekognition

Age 24-34
Gender Male, 99.5%
Calm 82.8%
Disgusted 8.1%
Confused 2.8%
Angry 1.7%
Fear 1.7%
Happy 1.2%
Surprised 1%
Sad 0.8%

AWS Rekognition

Age 23-31
Gender Male, 98.1%
Calm 77.6%
Sad 14.3%
Happy 2.4%
Fear 2.1%
Angry 2%
Disgusted 0.7%
Confused 0.5%
Surprised 0.3%

AWS Rekognition

Age 12-20
Gender Female, 94.5%
Calm 56.1%
Sad 36%
Confused 2.2%
Angry 1.4%
Happy 1.2%
Fear 1.1%
Disgusted 1.1%
Surprised 0.9%

AWS Rekognition

Age 18-26
Gender Male, 96.8%
Calm 62.1%
Sad 18.4%
Confused 6%
Disgusted 4.3%
Angry 3.4%
Surprised 2.2%
Happy 1.9%
Fear 1.7%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 90.5%
Sad 2.6%
Happy 2%
Angry 1.5%
Fear 1.4%
Disgusted 0.8%
Confused 0.6%
Surprised 0.6%

AWS Rekognition

Age 23-33
Gender Male, 87.5%
Calm 36.4%
Angry 29.4%
Disgusted 17.3%
Sad 6.1%
Fear 5%
Confused 2.2%
Surprised 2.1%
Happy 1.5%

AWS Rekognition

Age 13-21
Gender Female, 68.8%
Calm 96.7%
Sad 2.2%
Angry 0.4%
Happy 0.2%
Fear 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 6-14
Gender Male, 76.1%
Sad 75.7%
Calm 15.9%
Fear 4.8%
Angry 1.2%
Confused 0.9%
Disgusted 0.8%
Happy 0.4%
Surprised 0.2%

AWS Rekognition

Age 16-22
Gender Female, 99.8%
Angry 55.8%
Calm 19.6%
Fear 5.6%
Sad 5.4%
Surprised 4.7%
Confused 4.5%
Disgusted 2.6%
Happy 1.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a group of people posing for a photo 79.2%
a group of people posing for the camera 79.1%
a group of people posing for a picture 79%