Human Generated Data

Title

Untitled (group in home at banquet with banner in French )
Date

c. 1929, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5862

Human Generated Data

Title

Untitled (group in home at banquet with banner in French )

People

Artist: Durette Studio, American 20th century

Date

c. 1929, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.5
Human 99.5
Person 99.3
Person 98.4
Person 97.8
Person 94.7
Person 90.9
Person 89.8
Restaurant 86.2
Furniture 84.5
Room 84.4
Indoors 84.4
Person 83.8
Accessory 83.2
Tie 83.2
Accessories 83.2
Person 83.1
People 80.8
Person 80.6
Meal 80.3
Food 80.3
Table 78
Dining Table 77.4
Person 74.4
Person 71.9
Person 70.8
Person 69
Crowd 68.6
Dating 65.6
Person 63.8
Dinner 63.7
Supper 63.7
Food Court 62.8
Pub 60.9
Person 60.9
Bar Counter 59.9
Party 57.6
Person 55.5

Clarifai
created on 2019-11-16

people 99.9
group 99.7
group together 99.5
many 99.4
adult 96.8
man 96
woman 93.9
furniture 93.1
sit 91.8
several 91
crowd 90.3
leader 89.8
administration 89.7
military 88.2
room 86.3
child 85.9
wear 83.7
war 81.9
recreation 81.4
chair 79.9

Imagga
created on 2019-11-16

grunge 23
art 22.4
black 20.6
silhouette 19
man 18.6
person 15.5
male 14.9
vintage 14.9
people 13.4
design 12.9
graphic 12.4
poster 12.3
paint 11.8
dirty 11.7
retro 11.5
business 10.9
drawing 10.9
old 10.4
window 10.4
sport 10
painting 9.9
team 9.9
office 9.8
businessman 9.7
city 9.1
modern 9.1
symbol 8.7
antique 8.6
party 8.6
world 8.6
decoration 8.6
men 8.6
freedom 8.2
pattern 8.2
aged 8.1
frame 7.8
play 7.8
ink 7.7
wall 7.7
sketch 7.7
texture 7.6
style 7.4
letter 7.3
group 7.2
splash 7.1

Google
created on 2019-11-16

Photograph 96.5
People 94.8
Black-and-white 89
Snapshot 86
Monochrome 80.3
Photography 78
Room 65.7
Art 65.5
Monochrome photography 64.7
Family 62.3
Stock photography 62.1
Child 57.3
Photographic paper 52.1

Microsoft
created on 2019-11-16

text 97.9
person 97.6
clothing 95.1
posing 92
man 91.7
woman 89.9
group 88.8
old 74.6
bottle 69.9
food 68.9
people 68.7
black and white 63.4
human face 55.7
crowd 25.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-42
Gender Male, 88.8%
Surprised 0.4%
Sad 0.3%
Disgusted 0.1%
Calm 97.6%
Fear 0%
Angry 1.2%
Happy 0.1%
Confused 0.4%

AWS Rekognition

Age 12-22
Gender Male, 50.4%
Angry 45.2%
Happy 45%
Disgusted 45%
Calm 50%
Fear 45.4%
Surprised 45.4%
Sad 49%
Confused 45.1%

AWS Rekognition

Age 16-28
Gender Female, 53.8%
Disgusted 45%
Calm 45.1%
Surprised 45%
Fear 45.1%
Happy 45%
Confused 45%
Sad 54.7%
Angry 45%

AWS Rekognition

Age 34-50
Gender Male, 83.1%
Confused 24.6%
Disgusted 0.9%
Surprised 3.1%
Calm 59.8%
Angry 6.4%
Sad 3.6%
Happy 0.6%
Fear 1.1%

AWS Rekognition

Age 26-40
Gender Male, 99.6%
Disgusted 1.2%
Calm 33.2%
Surprised 46.4%
Fear 11.4%
Happy 0.4%
Confused 1.8%
Sad 2.2%
Angry 3.4%

AWS Rekognition

Age 36-52
Gender Male, 54.8%
Calm 52.8%
Disgusted 45.1%
Surprised 45.2%
Fear 45.3%
Happy 45.1%
Angry 45.6%
Confused 45.5%
Sad 45.5%

AWS Rekognition

Age 24-38
Gender Female, 99.6%
Calm 52.9%
Fear 1.3%
Disgusted 4.7%
Surprised 1%
Happy 0.6%
Angry 16.2%
Confused 2.4%
Sad 20.8%

AWS Rekognition

Age 32-48
Gender Male, 52.3%
Fear 53.6%
Calm 45.1%
Sad 45.4%
Surprised 45.2%
Disgusted 45.1%
Angry 45.6%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 14-26
Gender Female, 54.7%
Surprised 45.1%
Fear 51.2%
Happy 45%
Sad 48.1%
Calm 45.2%
Disgusted 45.1%
Angry 45.1%
Confused 45.3%

AWS Rekognition

Age 22-34
Gender Female, 58.7%
Sad 1.2%
Disgusted 0.3%
Confused 0.3%
Surprised 0.1%
Angry 0.6%
Calm 97.4%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 38-56
Gender Male, 94.4%
Angry 1.2%
Disgusted 0.1%
Fear 0.3%
Sad 0.2%
Happy 0%
Calm 0.3%
Confused 97.4%
Surprised 0.6%

AWS Rekognition

Age 12-22
Gender Female, 55%
Disgusted 45.2%
Happy 47.6%
Angry 45.2%
Confused 45.4%
Calm 46.6%
Fear 46.7%
Sad 48.2%
Surprised 45.2%

AWS Rekognition

Age 21-33
Gender Female, 54.5%
Fear 48.4%
Angry 45.9%
Calm 46.3%
Surprised 45.6%
Happy 46.2%
Confused 45.6%
Sad 46.6%
Disgusted 45.3%

AWS Rekognition

Age 23-35
Gender Female, 52.8%
Calm 52.8%
Disgusted 45%
Happy 45%
Fear 45.1%
Confused 45%
Angry 45.1%
Surprised 45.1%
Sad 46.9%

AWS Rekognition

Age 24-38
Gender Male, 54.5%
Surprised 45.1%
Calm 45%
Fear 54.7%
Disgusted 45%
Happy 45%
Angry 45.1%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 19-31
Gender Male, 54.5%
Sad 46%
Surprised 45%
Angry 45.9%
Confused 45%
Fear 45%
Happy 45%
Calm 53.1%
Disgusted 45%

AWS Rekognition

Age 29-45
Gender Male, 50.3%
Fear 46.4%
Happy 45%
Confused 45.1%
Calm 45.3%
Disgusted 45%
Sad 53.1%
Angry 45.1%
Surprised 45%

AWS Rekognition

Age 16-28
Gender Male, 50.5%
Calm 50.3%
Angry 49.6%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 49.6%
Fear 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.3%
Confused 49.5%
Calm 49.7%
Sad 50%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.7%
Angry 49.5%

AWS Rekognition

Age 30-46
Gender Male, 50.4%
Happy 49.5%
Sad 49.6%
Disgusted 49.5%
Fear 50.3%
Calm 49.5%
Angry 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 37-55
Gender Female, 52.8%
Sad 45.6%
Surprised 45%
Angry 45%
Calm 45%
Happy 45%
Fear 54.3%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 22-34
Gender Male, 50.1%
Angry 49.5%
Sad 49.7%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Fear 50.3%
Happy 49.5%

AWS Rekognition

Age 25-39
Gender Female, 52.6%
Happy 45.1%
Angry 47.1%
Disgusted 45.2%
Confused 45.5%
Sad 49.1%
Calm 46.1%
Surprised 45.3%
Fear 46.6%

AWS Rekognition

Age 22-34
Gender Male, 50.1%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.7%
Angry 49.5%
Fear 49.6%
Disgusted 49.5%
Calm 50.2%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 83.2%

Captions

Microsoft

a group of people posing for a photo in front of a crowd 96.6%
a group of people standing in front of a crowd posing for the camera 95.7%
a vintage photo of a group of people posing for the camera 95.6%

Text analysis

Amazon

DIFU
BEKISSE
VE

Google

OUVE AUX MARI QUE DIEU REKISSE
OUVE
AUX
MARI
QUE
DIEU
REKISSE