Human Generated Data

Title

Untitled (couple with four children sitting at bottom of staircase inside elegant house)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9145

Human Generated Data

Title

Untitled (couple with four children sitting at bottom of staircase inside elegant house)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9145

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.4
Apparel 99.4
Person 99.2
Human 99.2
Person 98.7
Person 98.6
Person 97.5
Chair 96.7
Furniture 96.7
Person 95.7
Suit 81.3
Coat 81.3
Overcoat 81.3
Tie 76.1
Accessories 76.1
Accessory 76.1
People 72.2
Face 71.8
Shorts 69.9
Female 68.3
Shoe 65.4
Footwear 65.4
Portrait 64.9
Photography 64.9
Photo 64.9
Shirt 63.1
Sunglasses 59.7
Flooring 58.8
Tuxedo 58.1
Sitting 57.6
Leisure Activities 55.9
Crowd 55.8

Clarifai
created on 2023-10-26

people 99.9
group together 99.2
adult 99
man 98.7
group 98.7
woman 97.5
child 95.8
administration 94
music 91.3
many 90
recreation 89
facial expression 88.9
leader 88.9
several 88.7
wear 88.6
monochrome 88.4
three 87.6
musician 87.1
four 85.3
chair 85

Imagga
created on 2022-01-23

newspaper 71
product 52.3
creation 40.9
man 37
male 34
office 31
business 29.1
people 28.4
adult 26.9
work 26.7
businessman 26.5
person 26.1
professional 23.6
computer 22.5
group 20.9
job 20.3
desk 19.8
men 19.7
occupation 19.2
corporate 18.9
working 17.7
smiling 17.4
room 15.8
manager 15.8
laptop 15.5
worker 15.3
smile 15
technology 14.8
executive 14.7
sitting 14.6
team 14.3
indoors 14.1
education 13.8
happy 13.8
indoor 13.7
looking 13.6
handsome 13.4
teamwork 13
businesswoman 12.7
hospital 12.7
women 12.6
building 12.4
meeting 12.2
doctor 12.2
20s 11.9
communication 11.8
senior 11.2
company 11.2
alone 11
medical 10.6
attractive 10.5
serious 10.5
success 10.5
patient 10.5
businesspeople 10.4
health 10.4
clinic 10.4
portrait 10.4
casual 10.2
coat 10
face 9.9
one 9.7
black 9.6
table 9.5
writing 9.4
lifestyle 9.4
two 9.3
mature 9.3
student 9.2
sax 9.1
holding 9.1
care 9
discussion 8.8
together 8.8
happiness 8.6
shop 8.4
horizontal 8.4
phone 8.3
engineer 8.2
cheerful 8.1
suit 8.1
family 8
daily 8
medicine 7.9
discussing 7.9
pensive 7.8
designer 7.7
partner 7.7
pretty 7.7
project 7.7
old 7.7
exam 7.7
chart 7.6
illness 7.6
talking 7.6
learning 7.5
case 7.4
new 7.3
confident 7.3
home 7.2
day 7.1

Google
created on 2022-01-23

Photograph 94.1
Black-and-white 84.5
Style 83.8
Art 75
Motor vehicle 74.3
Snapshot 74.3
Monochrome photography 73.2
Suit 70.5
Monochrome 69.2
Room 68.7
Stock photography 65
Event 65
Sitting 61.8
Vintage clothing 61.5
Classic 61.5
Illustration 60.9
Visual arts 59.6
Hat 59.5
Chair 55.3
History 54.8

Microsoft
created on 2022-01-23

text 99.3
clothing 90.9
person 90.5
man 65.8
cartoon 63.4
black and white 63.4
woman 61.2
drawing 57.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 98.2%
Happy 59.8%
Surprised 21.9%
Confused 6.1%
Calm 5.7%
Sad 3.4%
Fear 1.1%
Disgusted 1.1%
Angry 0.9%

AWS Rekognition

Age 39-47
Gender Male, 86.7%
Happy 74.2%
Calm 14.7%
Disgusted 4.2%
Surprised 2.5%
Sad 1.9%
Confused 1.4%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 25-35
Gender Male, 97.5%
Surprised 97.7%
Calm 1.2%
Fear 0.4%
Happy 0.2%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.1%
Calm 80.7%
Surprised 7.8%
Happy 5.2%
Confused 3.5%
Sad 1.5%
Disgusted 0.6%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 58.6%
Calm 99.7%
Surprised 0.1%
Confused 0.1%
Sad 0.1%
Happy 0%
Disgusted 0%
Fear 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 76.1%
Sunglasses 59.7%

Categories

Imagga

people portraits 89.6%
paintings art 7.9%
streetview architecture 1.1%

Text analysis

Amazon

rt
MJI7
R
MJI7 YT37AS
YT37AS

Google

T 3 I | a
T
3
I
|
a