Human Generated Data

Title

Untitled (Mexican Independence Day, coronation of queen)

Date

1948

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2895

Human Generated Data

Title

Untitled (Mexican Independence Day, coronation of queen)

People

Artist: Harry Annas, American 1897 - 1980

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-23

Clothing 100
Apparel 100
Human 98.3
Person 98.3
Person 98.2
Person 97.9
Person 97.3
Fashion 97.1
Gown 97.1
Robe 97
Wedding 96.7
Person 95.6
Person 95.3
Person 95
Wedding Gown 92.8
Bride 92.8
Person 90.6
Person 87.6
Person 87.1
Person 85.2
Person 83.7
Person 83.7
Person 81.4
Indoors 77
Female 76.3
Person 64.6
Person 63.2
Person 61
Aisle 57.9
Woman 57.7

Clarifai
created on 2019-03-23

people 99.8
many 99.5
group together 99
group 98.5
crowd 96.6
adult 95.5
man 94.6
military 92.7
war 90.7
wear 89.5
street 88.2
vehicle 88
woman 87.9
monochrome 85.8
leader 85
administration 82.2
soldier 81.8
home 81.3
outfit 78
ceremony 76.8

Imagga
created on 2019-03-23

architecture 22.3
city 21.6
water 18.7
river 16.9
pier 16.4
travel 16.2
support 15.5
building 15.2
urban 14.9
crowd 14.4
ocean 14.1
sea 14.1
sky 14
bridge 13.8
dairy 13.3
structure 12.7
landscape 12.6
people 12.3
coat hanger 12.1
scene 12.1
tourism 11.5
business 11.5
group 11.3
hanger 10.7
construction 10.3
laundry 9.9
silhouette 9.9
boutique 9.8
station 9.7
symbol 9.4
stall 9.4
stone 9.3
beach 9.3
old 9.1
landmark 9
wall 9
coast 9
reflection 8.9
gate 8.7
cloud 8.6
clouds 8.4
lights 8.3
tourist 8.3
light 8
night 8
steel 8
rural 7.9
culture 7.7
seascape 7.6
outdoor 7.6
occupation 7.3
new 7.3
industrial 7.3
device 7.2
horizon 7.2
sunset 7.2
bright 7.1
flag 7.1
day 7.1
scenic 7

Google
created on 2019-03-23

Microsoft
created on 2019-03-23

road 96.1
outdoor 90.9
white 80.9
people 76.2
black 73
wedding 73
black and white 5.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 49.7%
Disgusted 49.6%
Surprised 49.6%
Sad 49.6%
Angry 49.5%
Happy 49.9%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Happy 49.5%
Sad 49.9%
Calm 49.9%
Confused 49.5%
Angry 49.6%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Happy 49.5%
Sad 49.5%
Calm 49.5%
Surprised 49.5%
Angry 49.5%
Disgusted 50.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Calm 49.7%
Disgusted 49.5%
Surprised 49.5%
Sad 49.7%
Angry 49.6%
Happy 49.9%
Confused 49.6%

AWS Rekognition

Age 48-68
Gender Male, 50%
Surprised 49.5%
Angry 49.6%
Confused 49.5%
Calm 49.8%
Sad 49.6%
Happy 49.8%
Disgusted 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Happy 49.6%
Surprised 49.6%
Confused 49.7%
Sad 49.7%
Calm 49.7%
Angry 49.6%
Disgusted 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Sad 49.7%
Calm 50.1%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.5%
Calm 49.6%
Surprised 49.5%
Happy 50.3%
Sad 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 57-77
Gender Female, 50.3%
Sad 50.2%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.5%
Happy 49.7%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Sad 50.2%
Calm 49.7%
Surprised 49.5%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Calm 49.5%
Happy 49.5%
Angry 49.6%
Sad 50.2%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.6%
Disgusted 49.5%
Happy 49.5%
Sad 50.1%
Surprised 49.5%
Calm 49.7%
Confused 49.6%

AWS Rekognition

Age 48-68
Gender Male, 50.1%
Angry 49.6%
Calm 49.7%
Disgusted 49.5%
Sad 50.1%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 14-25
Gender Female, 50.5%
Happy 49.8%
Calm 49.6%
Confused 49.6%
Disgusted 49.6%
Sad 49.8%
Surprised 49.6%
Angry 49.6%

AWS Rekognition

Age 48-68
Gender Male, 50.4%
Disgusted 49.6%
Surprised 49.5%
Angry 49.6%
Sad 49.7%
Calm 50.1%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Confused 49.8%
Calm 49.8%
Disgusted 49.5%
Surprised 49.6%
Sad 49.8%
Angry 49.5%
Happy 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.3%
Angry 49.8%
Surprised 49.5%
Disgusted 49.6%
Sad 49.8%
Calm 49.7%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.2%
Sad 50.2%
Confused 49.5%
Surprised 49.5%
Calm 49.6%
Disgusted 49.6%
Happy 49.5%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Calm 49.5%
Confused 49.5%
Angry 49.5%
Sad 50.3%
Surprised 49.5%
Disgusted 49.6%
Happy 49.5%

AWS Rekognition

Age 4-7
Gender Male, 54.8%
Happy 45.2%
Angry 45%
Surprised 45.1%
Sad 45.2%
Calm 54.2%
Confused 45.2%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 50%
Sad 49.7%
Surprised 49.6%
Calm 49.9%
Happy 49.5%
Confused 49.6%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 19-36
Gender Male, 50.3%
Sad 49.8%
Disgusted 49.9%
Calm 49.5%
Surprised 49.5%
Confused 49.6%
Angry 49.5%
Happy 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Happy 49.6%
Surprised 49.6%
Calm 49.7%
Angry 49.6%
Confused 49.6%
Sad 49.9%
Disgusted 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Angry 49.6%
Sad 49.6%
Happy 49.5%
Disgusted 49.5%
Calm 50.2%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 52.2%
Confused 45.6%
Calm 46.7%
Disgusted 45.4%
Surprised 45.5%
Sad 50.8%
Angry 45.7%
Happy 45.3%

AWS Rekognition

Age 14-25
Gender Male, 50.1%
Surprised 49.6%
Confused 49.6%
Happy 49.6%
Calm 49.9%
Angry 49.6%
Sad 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.6%
Surprised 49.6%
Disgusted 49.5%
Sad 49.6%
Calm 50%
Happy 49.7%
Confused 49.6%

AWS Rekognition

Age 16-27
Gender Male, 50.2%
Calm 50.2%
Angry 49.5%
Sad 49.7%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50%
Disgusted 50.4%
Confused 49.5%
Happy 49.5%
Sad 49.5%
Calm 49.5%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.6%
Disgusted 49.5%
Sad 50.2%
Angry 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50%
Calm 49.7%
Disgusted 49.7%
Surprised 49.5%
Sad 49.7%
Angry 49.7%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 48-68
Gender Female, 50.4%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Sad 50.2%
Calm 49.6%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 49.5%
Disgusted 50.4%
Surprised 49.5%
Angry 49.5%
Calm 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 49.8%
Disgusted 49.5%
Calm 49.8%
Angry 49.5%
Happy 49.6%
Surprised 49.6%
Confused 49.7%

Feature analysis

Amazon

Person 98.3%

Captions

Microsoft

a group of people standing in front of a crowd 88.2%
a group of people standing outside of a building 88.1%
a group of people standing next to a road 88%

Text analysis

Amazon

33A2
1