Human Generated Data

Title

Untitled (mother with four children)
Date

c. 1945
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1454

Human Generated Data

Title

Untitled (mother with four children)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Sitting 98.2
Person 97.8
Person 97.2
Person 96.9
Crowd 96.5
Clothing 95.9
Suit 95.9
Coat 95.9
Overcoat 95.9
Apparel 95.9
Person 94.9
Suit 83
Press Conference 82
Tie 80.5
Accessory 80.5
Accessories 80.5
Text 77.9
People 73.1
Suit 62.8
Tie 61.7
Performer 57.1
Audience 56.9
Jury 55.2

Imagga
created on 2022-01-22

businessman 55.7
office 52.4
business 51.7
businesswoman 49.1
meeting 47.2
man 45.7
group 45.2
team 43.9
corporate 43
businesspeople 41.8
colleagues 39.9
male 36.3
executive 34.5
teamwork 34.3
people 34.1
professional 32.6
job 29.2
happy 28.9
work 27.5
suit 27.4
person 26.8
adult 26.7
smiling 23.9
coworkers 22.6
men 22.3
together 21.9
success 21.7
director 21.7
corporation 21.2
laptop 21
manager 20.5
partners 20.4
career 19.9
desk 19.9
company 19.5
30s 19.3
partnership 19.2
working 18.6
businessmen 18.5
communication 18.5
computer 18.4
successful 18.3
lifestyle 18.1
associates 17.7
discussion 17.5
partner 17.4
table 17.3
sitting 17.2
attractive 16.8
indoors 16.7
indoor 16.5
confident 16.4
portrait 16.2
handsome 16.1
women 15.8
discussing 15.7
cheerful 15.5
room 15.3
businesswomen 14.7
20s 14.7
cooperation 14.5
busy 14.5
worker 14.4
staff 14.4
talking 14.3
occupation 13.8
looking 13.6
mid adult 13.5
classroom 13.4
workplace 13.4
tie 13.3
smile 12.8
25 30 years 12.7
40s 12.7
horizontal 12.6
presentation 12.1
modern 11.9
color 11.7
formal 11.5
buddy 11.2
boardroom 10.9
30 35 years 10.8
diverse 10.8
secretary 10.7
kin 10.7
diversity 10.6
four 10.6
boss 10.5
building 10.5
couple 10.5
standing 10.4
jacket 10.1
employee 9.8
entrepreneur 9.5
student 9.5
happiness 9.4
contemporary 9.4
friends 9.4
casual 9.3
two 9.3
groom 9.1
life 8.9
conference 8.8
employment 8.7
leadership 8.7
sales 8.7
adults 8.5
notebook 8.4
mature 8.4
document 8.4
teacher 7.9
collaboration 7.9
crew 7.9
well dressed 7.8
face 7.8
businessperson 7.8
consultant 7.8
workers 7.8
planning 7.7
pretty 7.7
expression 7.7
finance 7.6
females 7.6
senior 7.5
camera 7.4
friendly 7.3

Google
created on 2022-01-22

Photograph 94.2
Fashion 87.9
Blazer 76
Vintage clothing 74.3
Snapshot 74.3
Chair 74.1
Font 72.7
Event 72.4
Room 71.5
Suit 70
Classic 66.8
Stock photography 66.5
Sitting 66.2
Monochrome 65.7
Team 64.4
Fashion design 62.4
White-collar worker 60.8
Formal wear 59.9
History 59.6
Retro style 54.7

Microsoft
created on 2022-01-22

text 99.6
person 99.5
wall 98.3
posing 97.7
clothing 96.4
group 94.9
smile 90.6
people 90.2
old 83.5
human face 82.5
standing 75.2
black 65.4
man 59.9
woman 55.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 69%
Calm 54.3%
Sad 39.3%
Angry 4.3%
Confused 1.2%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Female, 100%
Calm 99.6%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Sad 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 16-22
Gender Male, 100%
Calm 99.9%
Angry 0%
Sad 0%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 9-17
Gender Male, 99.4%
Calm 99.2%
Angry 0.4%
Sad 0.2%
Confused 0.1%
Happy 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 12-20
Gender Female, 100%
Calm 99.9%
Sad 0%
Angry 0%
Confused 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Suit 95.9%
Tie 80.5%

Captions

Microsoft

a group of people posing for a photo 98.6%
a group of people sitting posing for the camera 98.5%
a group of people posing for the camera 98.4%

Text analysis

Amazon

PROOF
off
MARTIN
up
out
MARTIN SCHWEIG
that
make
SCHWEIG
it
fall
make better it fall
cut
mouth
cut off here
ends
better
hair
round out
here
SAINT-LOUIS
sticks up
hair off that
round
Rain ends
sticks
Rain
smoothdown
Zix
eyelashes

Google

aound out Raivs enda smooth dowr hare malee ut betted jall PROOF MARTIN SCHWEIG SAINT-LQUIS hair off that sticke up eyslashes. Cufoff he
enda
smooth
malee
up
ut
MARTIN
off
eyslashes.
he
out
betted
jall
PROOF
that
aound
Raivs
hare
SAINT-LQUIS
hair
sticke
dowr
SCHWEIG
Cufoff