Human Generated Data

Title

Untitled (row of men and a woman with shovels for Golden Age Home groundbreaking)

Date

1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3287

Human Generated Data

Title

Untitled (row of men and a woman with shovels for Golden Age Home groundbreaking)

People

Artist: Harry Annas, American 1897 - 1980

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.5
Person 99.5
Person 99.5
Person 99.4
Person 99.2
Person 99.1
Person 99.1
Person 98.3
Person 97.6
Apparel 97.1
Clothing 97.1
Person 95.7
Person 95.6
Person 94.2
Person 90.4
Person 89.3
Person 84.3
People 76.1
Evening Dress 70.2
Robe 70.2
Fashion 70.2
Gown 70.2
Person 69.6
Plant 65.4
Leisure Activities 60.2
Crypt 58.7
Wedding 58.4
Face 58.3
Ground 56.4
Female 55.8
Person 50.4

Imagga
created on 2022-01-22

picket fence 100
fence 100
barrier 100
obstruction 74.3
structure 38.4
silhouette 19
people 18.4
group 17.7
sky 15.9
old 14.6
tree 13.8
grunge 13.6
sun 12.9
men 12.9
man 12.8
black 12.6
sunset 12.6
outdoor 12.2
landscape 11.9
grass 11.9
vintage 11.6
scene 11.2
field 10.9
dark 10.9
crowd 10.6
outdoors 10.4
art 10.4
summer 10.3
outside 10.3
winter 10.2
male 9.9
ancient 9.5
light 9.4
park 9.1
retro 9
walking 8.5
business 8.5
travel 8.4
sport 8.2
dirty 8.1
together 7.9
couple 7.8
boy 7.8
life 7.8
antique 7.8
adult 7.8
friends 7.5
wood 7.5
child 7.5
hill 7.5
city 7.5
brown 7.4
freedom 7.3
backgrounds 7.3
aged 7.2
person 7.1
mountain 7.1
women 7.1
night 7.1
kid 7.1
paper 7.1
rural 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 97.6
black 87.4
white 81.2
wedding 68.1
person 62.8
old 62.6
posing 58.8
black and white 54.7

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 98.9%
Calm 57.9%
Happy 33.8%
Sad 2.6%
Confused 2.1%
Fear 1.7%
Surprised 0.7%
Disgusted 0.7%
Angry 0.5%

AWS Rekognition

Age 33-41
Gender Male, 95.2%
Calm 94.8%
Happy 4.7%
Surprised 0.2%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0%
Angry 0%

AWS Rekognition

Age 21-29
Gender Female, 58.1%
Sad 56.1%
Calm 27.6%
Disgusted 6%
Angry 3%
Fear 2.9%
Confused 2.6%
Happy 1%
Surprised 0.8%

AWS Rekognition

Age 26-36
Gender Female, 68.5%
Calm 79.9%
Happy 8.7%
Fear 3.6%
Angry 2.7%
Sad 2%
Confused 1.1%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 40-48
Gender Male, 73.6%
Calm 83.8%
Happy 11.2%
Fear 3.1%
Surprised 0.6%
Sad 0.5%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 82.7%
Calm 32.7%
Sad 17.5%
Confused 16.9%
Happy 12.6%
Disgusted 8%
Angry 5.7%
Fear 3.4%
Surprised 3.3%

AWS Rekognition

Age 24-34
Gender Male, 92.8%
Calm 84.9%
Happy 6.2%
Sad 5.9%
Confused 1.6%
Angry 0.7%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 47-53
Gender Female, 99.4%
Happy 97.1%
Calm 1.9%
Sad 0.6%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 27-37
Gender Female, 62.4%
Calm 76.9%
Happy 11.2%
Angry 3.9%
Surprised 2.4%
Sad 1.6%
Confused 1.4%
Disgusted 1.3%
Fear 1.3%

AWS Rekognition

Age 42-50
Gender Male, 99.3%
Calm 91.2%
Sad 3.9%
Happy 1.6%
Fear 1%
Confused 1%
Surprised 0.6%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 26-36
Gender Female, 94%
Calm 99.8%
Angry 0.1%
Sad 0%
Fear 0%
Happy 0%
Disgusted 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 26-36
Gender Male, 77.3%
Fear 96.6%
Calm 2.4%
Happy 0.5%
Sad 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Male, 91.3%
Fear 66.1%
Sad 8.7%
Calm 8.6%
Happy 6.1%
Confused 4.9%
Surprised 2.2%
Disgusted 1.9%
Angry 1.5%

AWS Rekognition

Age 18-24
Gender Female, 57.7%
Fear 63.9%
Calm 9.7%
Confused 7%
Sad 6.9%
Angry 5.9%
Surprised 3.6%
Disgusted 2.1%
Happy 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 84.4%
an old photo of a group of people posing for a picture 84.3%
an old photo of a group of people posing for the camera 83.1%

Text analysis

Amazon

SAFETY
SAFETY FILM
FILM
KODAK
B

Google

FILM
KODAK SAFETY FILM
SAFETY
KODAK