Human Generated Data

Title

Untitled (rephotograph of picture of group of men at table)

Date

c.1945

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22292

Human Generated Data

Title

Untitled (rephotograph of picture of group of men at table)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

c.1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.5
Human 99.5
Person 98.2
Poster 96.7
Advertisement 96.7
Person 96.3
Person 94.3
Person 90.2
Person 78.3
Person 75.7
Art 75.3
Person 75.3
Drawing 69.8
Person 66.5
Person 63
People 62.2
Person 60.7
Outdoors 58.2
Person 57.5
Photography 56.9
Photo 56.9
Game 56.4
Chess 56
Silhouette 55.1

Imagga
created on 2022-03-11

blackboard 47.3
musical instrument 20.4
man 18.1
person 17.4
oboe 15.8
grunge 15.3
male 14.9
wind instrument 14.2
black 13.8
people 13.4
old 13.2
building 12.9
stringed instrument 12.2
woodwind 12.1
silhouette 11.6
adult 11.1
art 11.1
dirty 10.8
style 10.4
human 9.7
bowed stringed instrument 9.7
body 9.6
wall 9.4
violin 9.1
business 9.1
vintage 9.1
holding 9.1
businessman 8.8
design 8.4
sax 8
women 7.9
device 7.9
architecture 7.8
glass 7.8
men 7.7
modern 7.7
texture 7.6
elegance 7.5
fashion 7.5
pattern 7.5
dark 7.5
frame 7.5
outdoors 7.5
retro 7.4
drawing 7.3
paint 7.2
color 7.2
flute 7.2
hair 7.1
chair 7

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

text 98.3
wall 97.3
person 96.5
clothing 94.1
man 92.8
drawing 76.9
black and white 74.8
sketch 50.5

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 58.9%
Calm 73.5%
Happy 25.9%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 23-31
Gender Female, 94.5%
Calm 87.8%
Disgusted 9.7%
Happy 1.6%
Surprised 0.5%
Angry 0.2%
Sad 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Calm 98.3%
Happy 0.7%
Surprised 0.3%
Confused 0.3%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0%

AWS Rekognition

Age 24-34
Gender Female, 87.4%
Calm 75%
Happy 7.9%
Sad 6%
Surprised 3.8%
Confused 2.2%
Disgusted 1.9%
Angry 1.9%
Fear 1.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 99.9%
Fear 0%
Happy 0%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 37-45
Gender Male, 95.9%
Calm 60.4%
Sad 27.7%
Happy 7.2%
Angry 1.7%
Disgusted 1.3%
Confused 0.7%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 31-41
Gender Male, 98.7%
Calm 99.4%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 87.6%
Calm 93.3%
Fear 2.8%
Sad 1.8%
Happy 1%
Confused 0.4%
Disgusted 0.3%
Surprised 0.3%
Angry 0.1%

AWS Rekognition

Age 24-34
Gender Female, 56.9%
Fear 45.6%
Sad 30.7%
Calm 16.8%
Disgusted 2.2%
Confused 1.9%
Angry 1.3%
Surprised 1.1%
Happy 0.4%

AWS Rekognition

Age 29-39
Gender Male, 97.9%
Sad 36.8%
Calm 31.9%
Fear 10.1%
Disgusted 8.5%
Confused 5%
Angry 2.6%
Surprised 2.6%
Happy 2.5%

AWS Rekognition

Age 21-29
Gender Female, 54.9%
Angry 59%
Calm 14.3%
Fear 8.8%
Sad 7.8%
Happy 4.7%
Disgusted 2.1%
Surprised 1.8%
Confused 1.5%

AWS Rekognition

Age 24-34
Gender Female, 56.4%
Happy 77.4%
Calm 7.9%
Angry 4.5%
Confused 4.3%
Sad 1.9%
Fear 1.7%
Surprised 1.3%
Disgusted 1%

AWS Rekognition

Age 24-34
Gender Female, 99.8%
Fear 29.5%
Calm 29.3%
Happy 25%
Surprised 6.4%
Sad 3.7%
Disgusted 3.5%
Angry 1.5%
Confused 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Poster 96.7%

Captions

Microsoft

an old photo of a man 57.8%
old photo of a man 54.2%
a group of people posing for a photo 35.3%

Text analysis

Amazon

FAMILY
FAMILY ENTRANCE
ENTRANCE

Google

ENTRANCE
FAMILY ENTRANCE
FAMILY