Human Generated Data

Title

Untitled (large family posing on dance floor at Bar Mitzvah)

Date

1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9540

Human Generated Data

Title

Untitled (large family posing on dance floor at Bar Mitzvah)

People

Artist: Martin Schweig, American 20th century

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Clothing 100
Apparel 100
Person 99.3
Human 99.3
Person 99.3
Person 99.1
Person 99.1
Robe 99
Fashion 99
Person 98.9
Person 98.8
Person 98.8
Gown 98.6
Person 97.9
Wedding 97.8
Wedding Gown 97.7
Bride 97.7
Person 97.2
Person 96.6
Person 89.2
Person 84.4
Bridegroom 81.6
Female 81.1
Person 80.3
Person 69.3
Woman 66.9
Person 66.8
Person 66.1
Photo 60.2
Photography 60.2
Evening Dress 59.5
Dress 58.6
Coat 57.5
Suit 57.5
Overcoat 57.5
People 56.6
Sleeve 55.4
Long Sleeve 55.4
Person 54.7

Imagga
created on 2022-01-28

person 41
man 37.7
nurse 36
people 35.7
adult 34.2
male 34
businessman 31.8
professional 31.2
group 29.8
business 29.7
team 27.8
happy 25.1
men 24.9
doctor 21.6
job 20.3
medical 20.3
smiling 20.2
worker 20
women 19
portrait 18.1
hospital 18
teacher 17.7
teamwork 17.6
colleagues 17.5
standing 17.4
room 16.7
businesswoman 16.4
30s 15.4
student 15.3
couple 14.8
suit 14.6
businesspeople 14.2
happiness 14.1
medicine 14.1
mature 13.9
corporate 13.7
stethoscope 13.6
smile 13.5
handsome 13.4
health 13.2
together 13.1
cheerful 13
success 12.9
office 12.8
work 12.6
golfer 12.4
meeting 12.2
coat 11.9
occupation 11.9
patient 11.8
40s 11.7
clinic 11.7
clothing 11.5
educator 11.4
desk 11.3
looking 11.2
two 11
casual 11
20s 11
care 10.7
mid adult 10.6
working 10.6
classroom 10.4
camera 10.2
associates 9.8
player 9.8
old 9.7
uniform 9.7
indoors 9.7
talking 9.5
enrollee 9.4
lifestyle 9.4
senior 9.4
blackboard 9.3
lab coat 9.2
confident 9.1
human 9
doctors 8.8
staff 8.8
diversity 8.6
crowd 8.6
day 8.6
executive 8.5
modern 8.4
attractive 8.4
manager 8.4
positive 8.3
friendly 8.2
family 8
surgeon 7.9
discussing 7.9
30 35 years 7.9
forties 7.8
contestant 7.8
black 7.8
clinical 7.8
discussion 7.8
color 7.8
four 7.7
confidence 7.7
negative 7.6
hand 7.6
adults 7.6
friends 7.5
employee 7.4
successful 7.3
child 7.1
love 7.1
face 7.1

Google
created on 2022-01-28

Font 80.1
Suit 76.5
Formal wear 72.4
Event 72.3
Vintage clothing 70
Monochrome 69.6
Room 66.4
Stock photography 63.8
Art 63.2
History 62.7
Rectangle 60.6
Monochrome photography 59.6
Team 58.6
Classic 57.3
Visual arts 55.5
Uniform 53.3

Microsoft
created on 2022-01-28

text 97.3
clothing 95.7
person 94.1
woman 90.3
wedding dress 89.4
bride 81.8
man 81
wedding 77.2
dress 69
old 68.7
dance 52.1
posing 45.9

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 98.4%
Happy 64.8%
Sad 17.2%
Calm 13%
Confused 1.6%
Disgusted 1%
Surprised 0.9%
Fear 0.8%
Angry 0.8%

AWS Rekognition

Age 37-45
Gender Male, 99.6%
Happy 87.8%
Sad 5.1%
Calm 4.8%
Confused 0.6%
Disgusted 0.5%
Surprised 0.4%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 34-42
Gender Male, 91.5%
Happy 55.7%
Calm 19%
Sad 12%
Confused 6.7%
Angry 2.3%
Disgusted 1.9%
Fear 1.3%
Surprised 1.2%

AWS Rekognition

Age 50-58
Gender Male, 97%
Sad 60.4%
Happy 26%
Confused 3.9%
Calm 3.5%
Disgusted 2.5%
Surprised 1.4%
Angry 1.3%
Fear 0.9%

AWS Rekognition

Age 45-53
Gender Male, 98.9%
Happy 89.3%
Sad 8.9%
Calm 0.4%
Disgusted 0.3%
Confused 0.3%
Angry 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Calm 97.9%
Sad 0.6%
Confused 0.5%
Happy 0.4%
Disgusted 0.2%
Fear 0.2%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 45-53
Gender Male, 95.7%
Calm 51.2%
Disgusted 16%
Confused 14.8%
Angry 9.9%
Surprised 2.8%
Sad 2.5%
Happy 1.7%
Fear 1.1%

AWS Rekognition

Age 34-42
Gender Male, 98.5%
Happy 35%
Sad 34.3%
Surprised 13.6%
Calm 6.4%
Confused 4.4%
Disgusted 3.8%
Angry 1.3%
Fear 1.1%

AWS Rekognition

Age 37-45
Gender Male, 98.8%
Sad 70.1%
Calm 15.2%
Happy 10.1%
Confused 1.4%
Surprised 1.2%
Angry 1.1%
Disgusted 0.8%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 85.1%
Happy 54.7%
Calm 28.7%
Surprised 8.8%
Sad 2.7%
Angry 2%
Confused 1.3%
Disgusted 1.3%
Fear 0.5%

AWS Rekognition

Age 35-43
Gender Female, 90.1%
Happy 91.1%
Calm 5.1%
Sad 1.9%
Confused 0.5%
Fear 0.4%
Surprised 0.4%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 42-50
Gender Male, 99.7%
Calm 71%
Happy 17%
Confused 3.5%
Sad 3.2%
Surprised 2.6%
Disgusted 1.5%
Angry 1%
Fear 0.2%

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Sad 54.4%
Surprised 14.3%
Happy 12.6%
Calm 10.1%
Angry 2.6%
Fear 2.1%
Confused 2%
Disgusted 1.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people posing for a photo 89.7%
an old photo of a group of people posing for a picture 88.5%
an old photo of a group of people posing for the camera 86.6%

Text analysis

Amazon

U
the
KODAK--ELA the
U 10st
KODAK--ELA
10st

Google

20 0 0 . A YTE7 A°2 - - XAGON
-
20
.
A°2
0
A
YTE7
XAGON