Human Generated Data

Title

Untitled (guests at table at party)

Date

1956

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19009

Human Generated Data

Title

Untitled (guests at table at party)

People

Artist: Bachrach Studios, founded 1868

Date

1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.2
Person 99.1
Person 98.7
Person 98
Person 97.2
Accessories 96.2
Tie 96.2
Accessory 96.2
Person 95.7
Plant 93.2
Flower 91.6
Blossom 91.6
Flower Bouquet 91.1
Flower Arrangement 91.1
Tie 85.3
Apparel 81.2
Clothing 81.2
Interior Design 69.1
Indoors 69.1
Coat 60
Overcoat 60
Suit 60
Crowd 59.2
Sitting 59
Priest 56.5
People 56.1

Imagga
created on 2022-03-05

man 43
male 35.5
people 35.1
kin 30.6
person 27.7
adult 25.2
couple 23.5
senior 22.5
home 22.3
men 21.5
happy 20
meeting 19.8
sitting 19.7
indoors 19.3
business 18.8
salon 18.3
women 18.2
smiling 17.4
lifestyle 17.3
mature 16.7
room 16.1
businessman 15.9
together 14.9
office 14.6
two 14.4
family 14.2
table 13.8
team 13.4
happiness 13.3
talking 13.3
group 12.9
smile 12.8
love 12.6
communication 12.6
old 12.5
elderly 12.4
businesspeople 12.3
professional 12.2
worker 12.2
businesswoman 11.8
handsome 11.6
cheerful 11.4
work 11.2
indoor 10.9
retired 10.7
interior 10.6
husband 10.5
portrait 10.3
patient 10.3
color 10
executive 10
teacher 10
grandfather 10
grandma 9.9
modern 9.8
hairdresser 9.8
two people 9.7
colleagues 9.7
medical 9.7
computer 9.6
education 9.5
corporate 9.4
desk 9.4
groom 9.3
teamwork 9.3
laptop 9.2
life 9.1
holding 9.1
suit 9
working 8.8
40s 8.8
discussion 8.8
30s 8.7
retirement 8.6
four 8.6
wife 8.5
adults 8.5
togetherness 8.5
casual 8.5
drink 8.3
health 8.3
lady 8.1
looking 8
70s 7.9
discussing 7.9
clinic 7.8
casual clothing 7.8
hospital 7.8
child 7.7
nurse 7.7
attractive 7.7
married 7.7
restaurant 7.5
doctor 7.5
enjoyment 7.5
fun 7.5
help 7.4
care 7.4
20s 7.3
aged 7.2
celebration 7.2
face 7.1
job 7.1
clothing 7

Google
created on 2022-03-05

Black-and-white 85.3
Style 83.9
Snapshot 74.3
Event 73.8
Suit 72.9
Monochrome 72.1
Monochrome photography 71.7
Art 70.1
Plant 69.4
Curtain 69.2
Vintage clothing 67.6
Hat 65.8
Conversation 65.7
History 64.7
White-collar worker 64.5
Room 63.8
Font 63.5
Sitting 62.1
Fun 58.4
Formal wear 55.1

Microsoft
created on 2022-03-05

person 98.8
text 94.3
clothing 91.7
man 84.5
black and white 82.7
human face 52.3
musical instrument 51.1

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 82.6%
Calm 67.6%
Sad 29%
Confused 2.2%
Angry 0.4%
Happy 0.2%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Surprised 82.3%
Calm 15.4%
Angry 1.4%
Confused 0.2%
Happy 0.2%
Disgusted 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 49-57
Gender Female, 98.3%
Calm 99.9%
Happy 0.1%
Disgusted 0%
Confused 0%
Sad 0%
Surprised 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 33-41
Gender Female, 71.1%
Calm 95.2%
Happy 2.6%
Sad 0.6%
Confused 0.6%
Angry 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 96.2%

Captions

Microsoft

a group of people sitting at a table 91.8%
a group of people sitting around a table 91.5%
a group of people looking at the camera 91.4%

Text analysis

Amazon

37
332
se

Google

2.
2.