Human Generated Data

Title

Untitled (young men and women sitting at gingham plaid tables at New Year's party)

Date

1952

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9417

Human Generated Data

Title

Untitled (young men and women sitting at gingham plaid tables at New Year's party)

People

Artist: Martin Schweig, American 20th century

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Chair 99.9
Furniture 99.9
Person 98.3
Human 98.3
Person 97.7
Person 93.9
Room 93.7
Indoors 93.7
Person 93.1
Person 93.1
Tablecloth 91.1
Clinic 89.8
Dining Table 89.1
Table 89.1
Dining Room 86.7
Person 84.8
Accessories 72.3
Accessory 72.3
Tie 72.3
Person 66.2
Hospital 56.6

Imagga
created on 2022-01-23

people 32.9
person 28.1
newspaper 26.9
man 26.9
negative 23.7
adult 22.7
hospital 21.2
room 20.5
indoors 20.2
product 20
male 19.2
indoor 19.2
lifestyle 18.8
portrait 18.8
film 18.8
casual 18.6
interior 17.7
home 16.7
smiling 15.9
business 15.2
happy 15
creation 14.9
photographic paper 14.5
day 14.1
table 13.6
office 13.2
work 13.1
women 12.7
medical 12.4
color 12.2
sitting 12
modern 11.9
clothing 11.6
doctor 11.3
men 11.2
professional 11
20s 11
relaxing 10.9
relaxation 10.9
shop 10.8
furniture 10.7
face 10.6
cheerful 10.6
desk 10.3
mature 10.2
smile 10
holding 9.9
team 9.8
worker 9.8
family 9.8
casual clothing 9.8
lady 9.7
health 9.7
chair 9.7
coat 9.7
businessman 9.7
photographic equipment 9.7
mid adult 9.6
laboratory 9.6
looking 9.6
couple 9.6
house 9.2
leisure 9.1
attractive 9.1
businesswoman 9.1
clinic 8.8
together 8.8
lab 8.7
instrument 8.7
love 8.7
bright 8.6
blackboard 8.5
horizontal 8.4
fashion 8.3
alone 8.2
one 8.2
group 8.1
patient 8
working 8
medicine 7.9
scientist 7.8
happiness 7.8
hands 7.8
education 7.8
corporate 7.7
pretty 7.7
old 7.7
two 7.6
businesspeople 7.6
adults 7.6
meeting 7.5
relaxed 7.5
senior 7.5
human 7.5
new 7.3
life 7.3
dress 7.2
job 7.1

Google
created on 2022-01-23

Chair 88.3
Style 83.9
Black-and-white 83.5
Plant 82.4
Adaptation 79.3
Art 78.7
Font 76.5
Table 73.2
Monochrome photography 72.7
Monochrome 71.9
Event 68.1
Room 67.8
Visual arts 67.5
Stock photography 63.8
History 63.8
Vintage clothing 63.7
Sitting 63.5
Tree 61.4
Illustration 59.6
Painting 58.1

Microsoft
created on 2022-01-23

text 97.3
chair 97.1
furniture 96.2
table 93.1
drawing 75.8
clothing 73.7
person 68.5
house 56.4

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Calm 98.3%
Sad 0.9%
Surprised 0.3%
Confused 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 26-36
Gender Female, 99.3%
Calm 96.7%
Happy 1.9%
Sad 0.4%
Surprised 0.3%
Confused 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.9%
Person 98.3%
Tie 72.3%

Captions

Microsoft

a group of people sitting in front of a window 63%
a group of people sitting at a table 62.9%
a group of people sitting at a table in front of a window 55.8%

Text analysis

Amazon

RODVK-SEELA
*****