Human Generated Data

Title

Untitled (wedding party at table)
Date

c. 1950
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19773

Human Generated Data

Title

Untitled (wedding party at table)

People

Artist: Unidentified Artist,

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.6
Person 99.6
Person 99.2
Person 99
Person 97.4
Person 96.7
Plant 96.1
Flower 91.7
Blossom 91.7
Flower Arrangement 91.7
Person 90.4
Chair 88
Furniture 88
Flower Bouquet 87.9
Clothing 80
Apparel 80
Person 79.5
Pottery 78.1
Jar 78.1
Vase 78.1
Crowd 70.3
Coat 64.1
Suit 64.1
Overcoat 64.1
Sitting 63.7
Dining Table 62
Table 62
Photography 60.5
Photo 60.5
Portrait 60.5
Face 60.5
People 58.4
Potted Plant 55.5
Art 55.4
Ikebana 55.4
Ornament 55.4
Chair 53.8

Imagga
created on 2022-03-05

salon 60
barbershop 47.6
shop 42
room 37.7
interior 30.1
indoors 29.9
chair 29.4
mercantile establishment 28.9
table 28.6
patient 26.8
person 26.6
man 25.5
male 24.1
people 24
restaurant 23.3
home 22.3
work 21.2
office 21.1
place of business 19.3
modern 18.9
sitting 17.2
smiling 16.6
happy 15
adult 14.7
business 14.6
lifestyle 14.5
furniture 14.3
talking 14.3
desk 14.2
together 14
occupation 13.7
men 13.7
classroom 13.6
hospital 13.5
working 13.3
case 13.2
meeting 13.2
computer 12.8
women 12.7
house 12.5
kitchen 12.5
clinic 12.5
sick person 12.5
nurse 12.2
indoor 11.9
communication 11.8
medical 11.5
dinner 11.5
dining 11.4
senior 11.2
professional 11.1
inside 11
food 11
design 10.7
establishment 10.6
job 10.6
businessman 10.6
floor 10.2
teamwork 10.2
meal 10.1
smile 10
team 9.9
cheerful 9.7
two people 9.7
hairdresser 9.7
mature 9.3
service 9.3
drink 9.2
building 9.1
health 9
group 8.9
decor 8.8
lunch 8.8
seat 8.8
couple 8.7
comfortable 8.6
empty 8.6
contemporary 8.5
doctor 8.5
elegance 8.4
life 8.4
laptop 8.2
businesswoman 8.2
technology 8.2
style 8.2
family 8
chairs 7.8
glass 7.8
colleagues 7.8
portrait 7.8
party 7.7
check 7.7
corporate 7.7
exam 7.7
worker 7.6
holding 7.4
coffee 7.4
care 7.4
light 7.4
window 7.3
success 7.2
decoration 7.2

Google
created on 2022-03-05

Table 90.1
Black 89.5
Black-and-white 85.9
Style 84
Chair 82.6
Cooking 75.3
Monochrome photography 74.6
Monochrome 74.6
Event 74.2
Curtain 72
Room 67.6
Stock photography 62.4
Art 61.2
History 59.6
Rehearsal dinner 58.5
Team 55.8
Dining room 53.7
Photography 52.5
Font 52.4
Meal 52.2

Microsoft
created on 2022-03-05

person 98.5
table 94.1
text 87.3
black and white 81.8
vase 72.5
people 66.7
group 64.5
candle 58
clothing 55.7

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 98.9%
Calm 92%
Sad 4.2%
Surprised 2.1%
Angry 0.6%
Happy 0.4%
Disgusted 0.2%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Female, 99.7%
Surprised 56.8%
Happy 26.9%
Calm 9.6%
Fear 4.6%
Sad 0.7%
Angry 0.6%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 33-41
Gender Male, 90.6%
Calm 87.1%
Happy 8.3%
Sad 0.9%
Confused 0.9%
Disgusted 0.9%
Surprised 0.9%
Angry 0.7%
Fear 0.4%

AWS Rekognition

Age 39-47
Gender Female, 98.9%
Calm 100%
Happy 0%
Confused 0%
Sad 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Chair 88%

Captions

Microsoft

a group of people standing around a table 93.6%
a group of people standing in a room 93.5%
a group of people in a room 93.4%

Text analysis

Amazon

st
RODAR-SVEETA

Google

st
st st