Human Generated Data

Title

Untitled (wedding group with girl in red on dance floor)
Date

1970s
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.558

Human Generated Data

Title

Untitled (wedding group with girl in red on dance floor)

People

Artist: Bachrach Studios, founded 1868

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Overcoat 99.2
Clothing 99.2
Coat 99.2
Apparel 99.2
Human 99.2
Person 99.2
Person 97.9
Shoe 97.6
Footwear 97.6
Person 97.1
Person 96.8
Wood 96.6
Person 95.7
Person 94.8
Person 94.8
Animal 94.3
Mammal 94.3
Dog 94.3
Canine 94.3
Pet 94.3
Flooring 93.3
Hardwood 90.7
Person 90.6
Person 90.5
Tuxedo 90
Floor 89.9
Person 87.1
Person 84.2
Fashion 79.2
Suit 78.6
Suit 78.1
Person 76.7
Suit 74.7
Suit 74.2
Person 71
Shoe 66.6
Person 65.9
Person 63.5
Leisure Activities 60.5
Premiere 57.5
Person 56.7
Female 56.4
Girl 56.4
Suit 56.2
Crowd 56
Shoe 55.9

Imagga
created on 2022-02-26

businessman 48.5
business 45.5
man 45
team 43
people 40.7
meeting 39.6
corporate 39.5
male 39
professional 37.4
businesspeople 37
office 36.9
teamwork 36.1
happy 34.4
men 34.3
group 33.8
suit 33.7
businesswoman 32.7
dog 32.1
executive 31.7
pug 26
work 25.1
adult 24.4
colleagues 23.3
job 23
standing 22.6
smiling 21.7
domestic animal 21.4
smile 21.4
portrait 21.3
partnership 21.1
canine 20.9
success 20.9
together 20.1
person 20.1
confident 20
staff 19.1
workplace 19.1
communication 18.5
successful 18.3
company 17.7
businessmen 17.5
partners 17.5
women 17.4
partner 17.4
diversity 17.3
working 16.8
coworkers 16.7
workers 16.5
sitting 16.3
career 16.1
manager 15.8
associates 15.7
discussing 15.7
handsome 15.1
couple 14.8
handshake 14.7
corporation 14.5
building 14.3
worker 14.2
attractive 14
trainer 13.6
cooperation 13.5
30s 13.5
happiness 13.3
indoors 13.2
leadership 12.5
teacher 12.4
tie 12.3
hands 12.2
diverse 11.7
discussion 11.7
holding 11.5
20s 11
modern 10.5
talking 10.5
black 10.2
interaction 9.8
ethnic 9.5
desk 9.4
lifestyle 9.4
guy 8.9
computer 8.8
businesswomen 8.8
looking 8.8
colleague 8.8
mid adult 8.7
planning 8.7
employee 8.6
boss 8.6
two 8.5
presentation 8.4
mature 8.4
hand 8.4
archive 8.3
environment 8.2
outdoors 8.2
cheerful 8.1
day 7.8
table 7.8
40s 7.8
agreement 7.8
busy 7.7
confidence 7.7
life 7.6
adults 7.6
contemporary 7.5
senior 7.5
laptop 7.4
friendly 7.3
love 7.1
pooch 7

Google
created on 2022-02-26

Trousers 96.1
Shoe 95.3
Dog 91.7
Tie 88.4
Coat 87.4
Carnivore 86.3
Gesture 85.3
Happy 82.3
Suit 81
Blazer 78.1
Formal wear 77.3
Companion dog 77.1
Friendship 74.6
Dog breed 74.6
Event 74
Fun 68.3
Flooring 66.1
Tuxedo 58.4
Tradition 57.7
Photo caption 52.8

Microsoft
created on 2022-02-26

person 100
indoor 93.4
clothing 93.1
suit 92
floor 90.4
man 86.3
group 66.2
woman 65.7
text 63.5
smile 54.8
crowd 0.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Male, 100%
Happy 99.9%
Sad 0%
Surprised 0%
Confused 0%
Calm 0%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 100%
Happy 99.8%
Surprised 0.1%
Angry 0%
Confused 0%
Sad 0%
Calm 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Female, 100%
Happy 99.5%
Surprised 0.2%
Fear 0.1%
Angry 0.1%
Confused 0%
Calm 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 99.4%
Sad 0.3%
Surprised 0.1%
Confused 0.1%
Calm 0.1%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 29-39
Gender Female, 100%
Happy 99%
Sad 0.3%
Surprised 0.2%
Fear 0.2%
Confused 0.1%
Calm 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Happy 43.3%
Angry 21.4%
Sad 11.4%
Surprised 7.9%
Calm 7.6%
Confused 3.4%
Disgusted 2.8%
Fear 2.2%

AWS Rekognition

Age 24-34
Gender Male, 100%
Happy 95%
Angry 3.9%
Confused 0.2%
Sad 0.2%
Fear 0.2%
Surprised 0.2%
Calm 0.1%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Female, 55.4%
Happy 92%
Surprised 4.6%
Calm 1.7%
Angry 0.6%
Confused 0.4%
Sad 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Happy 82.1%
Calm 12.8%
Surprised 2.5%
Confused 1%
Sad 0.5%
Fear 0.4%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 21-29
Gender Male, 98%
Happy 99.7%
Surprised 0.1%
Sad 0.1%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%
Calm 0%

AWS Rekognition

Age 23-31
Gender Male, 96.5%
Calm 41.7%
Happy 15.1%
Confused 9.8%
Angry 9.7%
Disgusted 7.9%
Sad 7.1%
Fear 4.6%
Surprised 4.2%

AWS Rekognition

Age 33-41
Gender Male, 99.2%
Happy 98.9%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%
Surprised 0.1%
Sad 0%
Calm 0%

AWS Rekognition

Age 41-49
Gender Male, 98%
Happy 98.1%
Surprised 0.7%
Fear 0.4%
Angry 0.3%
Sad 0.3%
Disgusted 0.1%
Confused 0.1%
Calm 0.1%

AWS Rekognition

Age 25-35
Gender Male, 91.9%
Sad 78.2%
Fear 18.4%
Calm 1.4%
Happy 0.9%
Angry 0.5%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Male, 92.9%
Calm 64.2%
Angry 15.8%
Surprised 11.7%
Sad 4%
Fear 1.8%
Happy 1.1%
Disgusted 0.8%
Confused 0.6%

AWS Rekognition

Age 20-28
Gender Male, 83.3%
Sad 69.8%
Calm 16%
Confused 4.4%
Fear 4.2%
Surprised 2.9%
Disgusted 1%
Happy 0.9%
Angry 0.8%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Shoe 97.6%
Dog 94.3%
Suit 78.6%

Captions

Microsoft

a group of people posing for the camera 95.5%
a group of people standing in front of a crowd posing for the camera 93%
a group of people posing for a picture 92.9%