Human Generated Data

Title

Untitled (group portrait of five young men and women sitting in front of curtain)
Date

c. 1920-1940, printed later
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12328

Human Generated Data

Title

Untitled (group portrait of five young men and women sitting in front of curtain)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1920-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.1
Human 99.1
Person 98.9
Clothing 96.1
Apparel 96.1
Person 95.5
Person 94.2
Sitting 93
Person 91
Suit 88.9
Overcoat 88.9
Coat 88.9
Stage 87
Crowd 86.7
Suit 80.7
Performer 73
Suit 73
People 65.5
Accessories 61.6
Tie 61.6
Accessory 61.6
Furniture 61.1
Press Conference 57.6
Footwear 57.2
Shoe 57.2
Couch 55.8

Clarifai
created on 2019-11-16

people 99.8
group 99.6
group together 99.3
leader 98.2
adult 96.7
administration 95.9
many 95.5
outfit 95.5
man 94.1
woman 93.6
five 92.9
wear 90.8
chair 89.5
several 88.4
actor 87.4
music 84.1
four 84.1
musician 83.8
singer 82.2
portrait 81.9

Imagga
created on 2019-11-16

brass 65.8
wind instrument 64.2
musical instrument 41.1
man 38.3
businessman 36.2
people 34
business 33.4
cornet 33.2
male 32.6
sax 28.1
adult 25.5
corporate 24.9
group 24.2
men 24
person 22.4
office 21.7
professional 20
silhouette 19
executive 18.8
team 17
meeting 17
black 16.6
couple 16.5
women 15.8
businesspeople 15.2
teamwork 14.8
work 14.1
suit 13.9
businesswoman 13.6
communication 13.4
boss 13.4
handsome 13.4
modern 13.3
trombone 12.9
sitting 12.9
success 12.9
job 12.4
manager 12.1
worker 11.6
employee 11.5
looking 11.2
indoor 11
happy 10.7
together 10.5
attractive 10.5
style 9.6
outfit 9.6
boy 9.6
love 9.5
happiness 9.4
youth 9.4
two 9.3
portrait 9.1
human 9
computer 8.9
oboe 8.7
corporation 8.7
crowd 8.6
tie 8.5
career 8.5
hand 8.4
stage 8.1
smiling 8
working 8
lifestyle 7.9
building 7.9
indoors 7.9
room 7.9
device 7.9
horn 7.8
standing 7.8
conference 7.8
colleagues 7.8
partner 7.7
expression 7.7
finance 7.6
chair 7.6
fashion 7.5
guy 7.5
fun 7.5
holding 7.4
laptop 7.3
confident 7.3
musician 7.2
sunset 7.2
singer 7.1
family 7.1

Google
created on 2019-11-16

Photograph 96.4
Snapshot 85.4
Gentleman 72.7
Photography 72.5
Black-and-white 68.3
Room 65.7
Family 62.3
Monochrome 54.4
Picture frame 51.9

Microsoft
created on 2019-11-16

person 98.7
clothing 98.6
suit 97.6
wall 96.5
man 94.4
smile 91.1
text 87.3
black 79.7
footwear 69.9
old 67.7
posing 66.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-29
Gender Male, 54.4%
Disgusted 45%
Surprised 45%
Happy 45.1%
Sad 45%
Angry 45%
Fear 45%
Calm 54.8%
Confused 45.1%

AWS Rekognition

Age 19-31
Gender Male, 54.4%
Confused 45%
Happy 45%
Disgusted 45%
Calm 55%
Angry 45%
Sad 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 14-26
Gender Male, 54.6%
Surprised 45%
Angry 45%
Fear 45%
Calm 54.9%
Confused 45%
Sad 45%
Disgusted 45%
Happy 45%

AWS Rekognition

Age 20-32
Gender Female, 50.6%
Fear 45%
Sad 45.1%
Disgusted 45%
Happy 45%
Angry 45%
Calm 54.8%
Surprised 45%
Confused 45%

AWS Rekognition

Age 12-22
Gender Male, 52.1%
Disgusted 45%
Happy 45%
Angry 45.1%
Fear 45%
Calm 54.8%
Sad 45%
Surprised 45%
Confused 45%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 88.9%
Tie 61.6%
Shoe 57.2%

Captions

Microsoft

a group of people posing for a photo 94.9%
a group of people posing for a photo in front of a window 91.9%
a group of people posing for a photo in front of a building 91.8%