Human Generated Data

Title

Untitled (large group of children and adults standing at bottom of staircase looking up)
Date

1962
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9859

Human Generated Data

Title

Untitled (large group of children and adults standing at bottom of staircase looking up)

People

Artist: Martin Schweig, American 20th century

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.4
Person 99.4
Person 99.4
Apparel 99
Clothing 99
Person 98.9
Person 98.1
Person 98.1
Person 97.8
Person 97.5
Person 97.4
Indoors 97.4
Interior Design 97.4
Person 94.6
Person 90.5
Person 89.6
Room 87.8
Face 86.4
People 76.8
Person 75.8
Floor 73.4
Coat 71.6
Tie 68.7
Accessory 68.7
Accessories 68.7
Portrait 67.5
Photo 67.5
Photography 67.5
Shorts 67.1
Female 64.8
Dress 63.8
Furniture 63.4
Person 62.5
Kid 59.4
Child 59.4
Living Room 57.7
Flooring 55.6
Advertisement 55.6
Head 55.5
Overcoat 55.5
Person 46.7

Imagga
created on 2022-01-28

man 38.3
people 34.6
person 32.5
nurse 30.9
male 30.5
adult 29.2
professional 29
businessman 28.2
business 24.9
teacher 24.8
team 23.3
happy 21.3
student 21.2
couple 20.9
group 19.3
job 18.6
two 17.8
teamwork 17.6
women 17.4
men 17.2
life 16.4
businesswoman 16.4
corporate 16.3
smiling 15.9
educator 15.6
businesspeople 15.2
medical 15
smile 15
mature 14.9
clothing 14.7
room 14.2
meeting 14.1
doctor 14.1
worker 13.8
office 13.7
colleagues 13.6
patient 13.5
work 13.3
senior 13.1
coat 13
education 13
portrait 12.9
occupation 12.8
home 12.8
casual 12.7
40s 12.7
old 12.5
suit 12
classroom 11.9
lab coat 11.8
lifestyle 11.6
hospital 11.4
indoors 11.4
20s 11
happiness 11
blackboard 10.7
working 10.6
30s 10.6
health 10.4
looking 10.4
sitting 10.3
camera 10.2
handsome 9.8
family 9.8
medicine 9.7
together 9.6
color 9.5
day 9.4
kin 9.4
modern 9.1
black 9
enrollee 9
discussing 8.8
forties 8.8
discussion 8.8
elderly 8.6
profession 8.6
boss 8.6
bright 8.6
adults 8.5
success 8
world 8
interior 8
love 7.9
standing 7.8
face 7.8
table 7.8
diversity 7.7
groom 7.7
executive 7.6
ethnic 7.6
talking 7.6
employee 7.5
human 7.5
care 7.4
cheerful 7.3
new 7.3
school 7.3
building 7.2

Google
created on 2022-01-28

Photograph 94.1
Black 89.7
Art 85.5
Dress 84.6
Black-and-white 83.5
Suit 76.8
Snapshot 74.3
Font 74.2
Monochrome photography 73.7
Classic 72.2
Event 71.7
Vintage clothing 71.6
Monochrome 70.6
Painting 68.6
Visual arts 67.7
Room 65.8
Stock photography 65
History 61.7
Illustration 61.4
Picture frame 61.1

Microsoft
created on 2022-01-28

person 97
clothing 96.9
text 95.7
man 89.5
woman 52.8
posing 38.8

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99%
Calm 77.9%
Surprised 14.6%
Sad 2.7%
Disgusted 2.1%
Angry 1.5%
Confused 0.6%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 16-22
Gender Male, 99.1%
Calm 32%
Angry 18.2%
Sad 17.4%
Disgusted 10%
Confused 9.9%
Surprised 7.1%
Happy 2.7%
Fear 2.7%

AWS Rekognition

Age 36-44
Gender Male, 64.5%
Sad 47.5%
Happy 20.9%
Calm 17.7%
Fear 3.6%
Angry 2.9%
Disgusted 2.9%
Surprised 2.6%
Confused 2.1%

AWS Rekognition

Age 14-22
Gender Male, 99.9%
Calm 97.3%
Sad 1.2%
Confused 0.5%
Disgusted 0.5%
Angry 0.3%
Surprised 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 30-40
Gender Male, 98.4%
Calm 96.6%
Surprised 1.4%
Fear 0.6%
Happy 0.6%
Disgusted 0.3%
Sad 0.2%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.1%
Sad 43.3%
Surprised 19%
Calm 10%
Fear 8.9%
Confused 5.6%
Disgusted 5.1%
Happy 5.1%
Angry 3.1%

AWS Rekognition

Age 18-24
Gender Male, 96.1%
Calm 97.4%
Happy 1%
Sad 0.6%
Confused 0.5%
Disgusted 0.3%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 89.7%
Calm 85.8%
Sad 10.2%
Surprised 1.5%
Confused 1%
Disgusted 0.5%
Happy 0.4%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 23-31
Gender Female, 99.2%
Calm 68.2%
Fear 17.8%
Surprised 4%
Sad 2.3%
Disgusted 2.1%
Happy 2.1%
Confused 1.9%
Angry 1.5%

AWS Rekognition

Age 18-26
Gender Male, 80.4%
Calm 99.5%
Surprised 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 81.4%
Calm 58.2%
Sad 39%
Confused 0.7%
Happy 0.5%
Surprised 0.5%
Fear 0.4%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 30-40
Gender Male, 75.3%
Calm 42.5%
Fear 22.6%
Confused 20.1%
Happy 5%
Angry 3.1%
Surprised 3.1%
Sad 2.6%
Disgusted 1.1%

AWS Rekognition

Age 6-14
Gender Male, 99.9%
Fear 43.6%
Calm 18.7%
Sad 15.7%
Disgusted 14.2%
Angry 2.7%
Happy 2.7%
Confused 1.7%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 68.7%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 82.8%
a group of people standing in front of a crowd 82.7%
a group of people posing for a photo 82.6%