Human Generated Data

Title

Untitled (mother with four children)

Date

c. 1945

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1454

Human Generated Data

Title

Untitled (mother with four children)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1454

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Sitting 98.2
Person 97.8
Person 97.2
Person 96.9
Crowd 96.5
Overcoat 95.9
Clothing 95.9
Apparel 95.9
Suit 95.9
Coat 95.9
Person 94.9
Suit 83
Press Conference 82
Accessories 80.5
Accessory 80.5
Tie 80.5
Text 77.9
People 73.1
Suit 62.8
Tie 61.7
Performer 57.1
Audience 56.9
Jury 55.2

Clarifai
created on 2023-10-26

group 99.8
people 99.8
adult 97.7
three 96.8
four 96.4
woman 96.4
group together 95.6
man 95.5
portrait 95.5
administration 92.4
leader 91.8
sit 91.2
five 90.7
monochrome 90
several 89.7
family 88.1
actor 85.9
music 85.2
offspring 84.8
retro 84

Imagga
created on 2022-01-22

businessman 55.7
office 52.4
business 51.7
businesswoman 49.1
meeting 47.2
man 45.7
group 45.2
team 43.9
corporate 43
businesspeople 41.8
colleagues 39.9
male 36.3
executive 34.5
teamwork 34.3
people 34.1
professional 32.6
job 29.2
happy 28.9
work 27.5
suit 27.4
person 26.8
adult 26.7
smiling 23.9
coworkers 22.6
men 22.3
together 21.9
success 21.7
director 21.7
corporation 21.2
laptop 21
manager 20.5
partners 20.4
career 19.9
desk 19.9
company 19.5
30s 19.3
partnership 19.2
working 18.6
businessmen 18.5
communication 18.5
computer 18.4
successful 18.3
lifestyle 18.1
associates 17.7
discussion 17.5
partner 17.4
table 17.3
sitting 17.2
attractive 16.8
indoors 16.7
indoor 16.5
confident 16.4
portrait 16.2
handsome 16.1
women 15.8
discussing 15.7
cheerful 15.5
room 15.3
businesswomen 14.7
20s 14.7
cooperation 14.5
busy 14.5
worker 14.4
staff 14.4
talking 14.3
occupation 13.8
looking 13.6
mid adult 13.5
classroom 13.4
workplace 13.4
tie 13.3
smile 12.8
25 30 years 12.7
40s 12.7
horizontal 12.6
presentation 12.1
modern 11.9
color 11.7
formal 11.5
buddy 11.2
boardroom 10.9
30 35 years 10.8
diverse 10.8
secretary 10.7
kin 10.7
diversity 10.6
four 10.6
boss 10.5
building 10.5
couple 10.5
standing 10.4
jacket 10.1
employee 9.8
entrepreneur 9.5
student 9.5
happiness 9.4
contemporary 9.4
friends 9.4
casual 9.3
two 9.3
groom 9.1
life 8.9
conference 8.8
employment 8.7
leadership 8.7
sales 8.7
adults 8.5
notebook 8.4
mature 8.4
document 8.4
teacher 7.9
collaboration 7.9
crew 7.9
well dressed 7.8
face 7.8
businessperson 7.8
consultant 7.8
workers 7.8
planning 7.7
pretty 7.7
expression 7.7
finance 7.6
females 7.6
senior 7.5
camera 7.4
friendly 7.3

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.6
person 99.5
wall 98.3
posing 97.7
clothing 96.4
group 94.9
smile 90.6
people 90.2
old 83.5
human face 82.5
standing 75.2
black 65.4
man 59.9
woman 55.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 69%
Calm 54.3%
Sad 39.3%
Angry 4.3%
Confused 1.2%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Female, 100%
Calm 99.6%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Sad 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 16-22
Gender Male, 100%
Calm 99.9%
Angry 0%
Sad 0%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 9-17
Gender Male, 99.4%
Calm 99.2%
Angry 0.4%
Sad 0.2%
Confused 0.1%
Happy 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 12-20
Gender Female, 100%
Calm 99.9%
Sad 0%
Angry 0%
Confused 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 13
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Suit 95.9%
Tie 80.5%

Categories

Imagga

people portraits 99.9%

Text analysis

Amazon

PROOF
off
MARTIN
up
out
MARTIN SCHWEIG
that
make
SCHWEIG
it
fall
make better it fall
cut
mouth
cut off here
ends
better
hair
round out
here
SAINT-LOUIS
sticks up
hair off that
round
Rain ends
sticks
Rain
smoothdown
Zix
eyelashes

Google

aound out Raivs enda smooth dowr hare malee ut betted jall PROOF MARTIN SCHWEIG SAINT-LQUIS hair off that sticke up eyslashes. Cufoff he
aound
out
Raivs
enda
PROOF
eyslashes.
smooth
dowr
hare
malee
ut
betted
jall
MARTIN
SCHWEIG
SAINT-LQUIS
hair
off
that
sticke
up
Cufoff
he