Human Generated Data

Title

Untitled (group portrait of young men and women posing around desk with open books)
Date

c. 1920-1940, printed later
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12331

Human Generated Data

Title

Untitled (group portrait of young men and women posing around desk with open books)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1920-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.4
Human 99.4
Person 98.9
Person 98.8
Person 98.4
Person 97.5
Person 97.5
Person 97.4
Person 97.2
Person 97.2
Person 95
Person 93.1
Person 91.7
Crowd 86.8
People 86.4
Indoors 80.4
Room 78.2
Person 72.2
Face 71.6
Person 71.5
Person 71.2
Audience 70.2
Sitting 66.5
Tie 61.6
Accessory 61.6
Accessories 61.6
Skin 59.9
School 59.9
Classroom 59.9
Apparel 58.7
Clothing 58.7
Workshop 57.5
Press Conference 57.4
Person 47.5

Clarifai
created on 2019-11-16

people 99.9
group 99.9
many 99.6
group together 99.3
adult 96.9
leader 96.3
music 95.8
woman 95.4
man 95.2
movie 93.9
musician 93.2
administration 92.7
several 92.5
theater 92.4
wear 91.4
singer 90.6
room 89.9
chair 89.8
audience 88.7
furniture 88.6

Imagga
created on 2019-11-16

man 41.7
male 34
people 33.5
person 31.4
business 31
businessman 30.9
adult 26.7
corporate 24.9
professional 23.5
groom 22
couple 21.8
office 21.7
men 21.5
executive 21.3
meeting 20.7
group 20.1
kin 19.7
happy 18.2
love 18.1
businesspeople 18
sitting 16.3
job 15.9
businesswoman 15.4
happiness 14.9
room 14.7
black 14.7
indoor 14.6
suit 14.3
lifestyle 13.7
communication 13.4
work 13.3
attractive 13.3
indoors 13.2
teacher 13.1
looking 12.8
women 12.7
team 12.5
handsome 12.5
portrait 12.3
together 12.3
modern 11.9
worker 11.9
conference 11.7
wind instrument 11.6
manager 11.2
teamwork 11.1
dress 10.8
businessmen 10.7
hand 10.6
interior 10.6
corporation 10.6
chair 10.4
career 10.4
togetherness 10.4
relationship 10.3
clothing 10.3
two 10.2
smiling 10.1
employee 10.1
smile 10
working 9.7
success 9.7
boss 9.6
table 9.5
elegant 9.4
silhouette 9.1
fashion 9
planner 8.9
romantic 8.9
family 8.9
night 8.9
coworkers 8.8
sexy 8.8
colleagues 8.7
tie 8.5
youth 8.5
passion 8.5
musical instrument 8.4
educator 8.4
holding 8.3
style 8.2
cheerful 8.1
romance 8
home 8
hands 7.8
model 7.8
couch 7.7
girlfriend 7.7
casual 7.6
horizontal 7.5
company 7.4
wine 7.4
life 7.4
window 7.3
lady 7.3
laptop 7.3
student 7.3
pose 7.2
face 7.1
hall 7.1
brass 7

Google
created on 2019-11-16

Photograph 96.5
People 94.1
Social group 92.8
Snapshot 83.6
Black-and-white 78.1
Picture frame 75.9
Event 69.4
Photography 67.8
Room 65.7
Portrait 63.4
Family 61.8
Team 59.4
Art 50.2

Microsoft
created on 2019-11-16

clothing 98.5
person 98.2
wall 96.5
smile 95.1
man 93.4
posing 90.7
text 88.8
group 86.1
human face 83.5
standing 81.8
people 67.4
suit 67
old 56.9
furniture 53.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-40
Gender Male, 53%
Sad 52.2%
Confused 45.1%
Fear 45%
Happy 45%
Surprised 45%
Angry 45.2%
Calm 47.4%
Disgusted 45%

AWS Rekognition

Age 12-22
Gender Female, 52.2%
Angry 46.2%
Sad 45.3%
Confused 45.1%
Surprised 45%
Happy 45%
Disgusted 45%
Calm 53.2%
Fear 45.1%

AWS Rekognition

Age 7-17
Gender Male, 53.1%
Sad 45%
Calm 55%
Angry 45%
Fear 45%
Happy 45%
Confused 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 13-25
Gender Male, 54.3%
Surprised 45.1%
Confused 45.1%
Sad 45.3%
Disgusted 45.1%
Angry 45.3%
Calm 54.2%
Fear 45%
Happy 45%

AWS Rekognition

Age 17-29
Gender Male, 54.5%
Happy 45%
Disgusted 45%
Fear 45%
Calm 54.9%
Angry 45%
Confused 45%
Sad 45%
Surprised 45%

AWS Rekognition

Age 13-23
Gender Female, 54%
Happy 45.1%
Disgusted 45.1%
Angry 45.1%
Fear 45.2%
Calm 54.1%
Surprised 45.1%
Sad 45.2%
Confused 45.1%

AWS Rekognition

Age 13-25
Gender Male, 53.4%
Surprised 45.1%
Fear 45%
Angry 45.2%
Disgusted 45.1%
Sad 45.6%
Calm 46%
Happy 45%
Confused 53%

AWS Rekognition

Age 21-33
Gender Male, 54.7%
Confused 45.1%
Surprised 45%
Sad 45.3%
Calm 54.6%
Disgusted 45%
Happy 45%
Fear 45%
Angry 45%

AWS Rekognition

Age 22-34
Gender Male, 54.7%
Fear 45.4%
Calm 48.1%
Sad 45.8%
Surprised 45.3%
Disgusted 45.9%
Angry 48.7%
Happy 45.1%
Confused 45.7%

AWS Rekognition

Age 13-23
Gender Female, 51.2%
Fear 45%
Surprised 45%
Angry 45%
Happy 45%
Disgusted 45%
Confused 45%
Sad 45.1%
Calm 54.9%

AWS Rekognition

Age 12-22
Gender Female, 54.6%
Sad 45%
Angry 55%
Happy 45%
Calm 45%
Fear 45%
Disgusted 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 12-22
Gender Male, 51.7%
Disgusted 45%
Happy 45%
Confused 45%
Angry 45%
Fear 45%
Sad 45%
Calm 54.9%
Surprised 45%

AWS Rekognition

Age 12-22
Gender Female, 54.1%
Fear 45%
Angry 45.2%
Happy 45.1%
Disgusted 45%
Confused 45.1%
Calm 54.2%
Sad 45.3%
Surprised 45%

AWS Rekognition

Age 29-45
Gender Male, 53.8%
Calm 51.9%
Fear 46%
Angry 45.2%
Disgusted 45%
Sad 46.6%
Happy 45%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 22-34
Gender Male, 54%
Happy 45%
Disgusted 45%
Calm 55%
Sad 45%
Surprised 45%
Confused 45%
Fear 45%
Angry 45%

AWS Rekognition

Age 28-44
Gender Male, 50.8%
Sad 46%
Confused 45.1%
Fear 45.1%
Happy 45%
Surprised 45%
Angry 45.2%
Calm 53.6%
Disgusted 45%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 61.6%

Captions

Microsoft

a group of people posing for a photo 98.4%
a group of people posing for the camera 98.3%
a group of people posing for a picture 98.2%