Human Generated Data

Title

Untitled (wedding party at table)

Date

c. 1950

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19773

Human Generated Data

Title

Untitled (wedding party at table)

People

Artist: Unidentified Artist,

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19773

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.6
Human 99.6
Person 99.2
Person 99
Person 97.4
Person 96.7
Plant 96.1
Flower Arrangement 91.7
Flower 91.7
Blossom 91.7
Person 90.4
Chair 88
Furniture 88
Flower Bouquet 87.9
Clothing 80
Apparel 80
Person 79.5
Vase 78.1
Jar 78.1
Pottery 78.1
Crowd 70.3
Suit 64.1
Coat 64.1
Overcoat 64.1
Sitting 63.7
Dining Table 62
Table 62
Portrait 60.5
Face 60.5
Photography 60.5
Photo 60.5
People 58.4
Potted Plant 55.5
Ikebana 55.4
Ornament 55.4
Art 55.4
Chair 53.8

Clarifai
created on 2023-10-22

people 99.9
group 98.8
group together 98.3
monochrome 97.9
woman 97.4
adult 97.3
man 97
many 96.9
recreation 92.1
wear 91.5
furniture 87.9
music 86.7
chair 86
administration 84.4
military 83
sitting 82.2
leader 82
sit 81.4
several 80.2
child 79.8

Imagga
created on 2022-03-05

salon 60
barbershop 47.6
shop 42
room 37.7
interior 30.1
indoors 29.9
chair 29.4
mercantile establishment 28.9
table 28.6
patient 26.8
person 26.6
man 25.5
male 24.1
people 24
restaurant 23.3
home 22.3
work 21.2
office 21.1
place of business 19.3
modern 18.9
sitting 17.2
smiling 16.6
happy 15
adult 14.7
business 14.6
lifestyle 14.5
furniture 14.3
talking 14.3
desk 14.2
together 14
occupation 13.7
men 13.7
classroom 13.6
hospital 13.5
working 13.3
case 13.2
meeting 13.2
computer 12.8
women 12.7
house 12.5
kitchen 12.5
clinic 12.5
sick person 12.5
nurse 12.2
indoor 11.9
communication 11.8
medical 11.5
dinner 11.5
dining 11.4
senior 11.2
professional 11.1
inside 11
food 11
design 10.7
establishment 10.6
job 10.6
businessman 10.6
floor 10.2
teamwork 10.2
meal 10.1
smile 10
team 9.9
cheerful 9.7
two people 9.7
hairdresser 9.7
mature 9.3
service 9.3
drink 9.2
building 9.1
health 9
group 8.9
decor 8.8
lunch 8.8
seat 8.8
couple 8.7
comfortable 8.6
empty 8.6
contemporary 8.5
doctor 8.5
elegance 8.4
life 8.4
laptop 8.2
businesswoman 8.2
technology 8.2
style 8.2
family 8
chairs 7.8
glass 7.8
colleagues 7.8
portrait 7.8
party 7.7
check 7.7
corporate 7.7
exam 7.7
worker 7.6
holding 7.4
coffee 7.4
care 7.4
light 7.4
window 7.3
success 7.2
decoration 7.2

Google
created on 2022-03-05

Table 90.1
Black 89.5
Black-and-white 85.9
Style 84
Chair 82.6
Cooking 75.3
Monochrome photography 74.6
Monochrome 74.6
Event 74.2
Curtain 72
Room 67.6
Stock photography 62.4
Art 61.2
History 59.6
Rehearsal dinner 58.5
Team 55.8
Dining room 53.7
Photography 52.5
Font 52.4
Meal 52.2

Microsoft
created on 2022-03-05

person 98.5
table 94.1
text 87.3
black and white 81.8
vase 72.5
people 66.7
group 64.5
candle 58
clothing 55.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 98.9%
Calm 92%
Sad 4.2%
Surprised 2.1%
Angry 0.6%
Happy 0.4%
Disgusted 0.2%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Female, 99.7%
Surprised 56.8%
Happy 26.9%
Calm 9.6%
Fear 4.6%
Sad 0.7%
Angry 0.6%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 33-41
Gender Male, 90.6%
Calm 87.1%
Happy 8.3%
Sad 0.9%
Confused 0.9%
Disgusted 0.9%
Surprised 0.9%
Angry 0.7%
Fear 0.4%

AWS Rekognition

Age 39-47
Gender Female, 98.9%
Calm 100%
Happy 0%
Confused 0%
Sad 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 99.6%
Person 99.2%
Person 99%
Person 97.4%
Person 96.7%
Person 90.4%
Person 79.5%
Chair 88%
Chair 53.8%

Categories

Text analysis

Amazon

st
RODAR-SVEETA

Google

st st
st