Human Generated Data

Title

Untitled (young boy and baby girl posed reading book on living room chair)
Date

c. 1940-1962
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9884

Human Generated Data

Title

Untitled (young boy and baby girl posed reading book on living room chair)

People

Artist: Martin Schweig, American 20th century

Date

c. 1940-1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Furniture 100
Armchair 98
Person 97.3
Human 97.3
Chair 96.3
Person 96.1
Person 71.1
Sitting 68.2
Couch 67.3
Cushion 66
Living Room 59.2
Indoors 59.2
Room 59.2

Imagga
created on 2022-01-28

laptop 52.4
scholar 42.3
person 39.7
computer 38.7
man 36.3
seat 34.6
intellectual 33.7
adult 33.7
sitting 32.6
working 30.9
work 29
male 28.4
people 26.8
business 26.7
home 26.3
happy 25.7
support 25.6
smile 24.2
smiling 23.9
office 23.4
notebook 22.7
technology 22.3
car 20.4
couch 20.3
businessman 19.4
plane seat 19
room 17.8
looking 17.6
indoors 17.6
device 17.5
attractive 17.5
happiness 17.2
house 15.9
men 15.5
lifestyle 15.2
worker 15.1
professional 14.6
communication 14.3
job 14.2
pretty 14
sofa 13.6
driver 13.6
handsome 13.4
resting 13.3
cheerful 13
corporate 12.9
one 12.7
modern 12.6
automobile 12.4
suit 12
television 12
indoor 11.9
casual 11.9
women 11.9
portrait 11.6
30s 11.5
interior 11.5
living 11.4
face 11.4
armchair 11.3
executive 11.2
vehicle 11.2
inside 11
passenger 11
businesswoman 10.9
leisure 10.8
newspaper 10.6
relaxing 10
student 10
driving 9.7
auto 9.6
one person 9.4
two 9.3
manager 9.3
relax 9.3
table 9
typing 8.8
seated 8.8
comfort 8.7
reading 8.6
career 8.5
finance 8.4
product 8.4
joy 8.4
color 8.3
transportation 8.1
success 8
rest 7.9
couple 7.8
boy 7.8
busy 7.7
jeans 7.6
sit 7.6
relaxed 7.5
child 7.5
occupation 7.3
black 7.2
cute 7.2
clothing 7.1
love 7.1
together 7

Google
created on 2022-01-28

Comfort 89.6
Style 83.8
Chair 82.7
Font 77.9
Rectangle 77
Armrest 74.1
Art 73.8
Monochrome photography 70.2
Monochrome 69.4
Sitting 69.1
Room 68.1
Lap 67.5
Club chair 65.4
Suit 64.9
Stock photography 64.6
Child 62.1
Toddler 60.7
Recliner 58.8
Paper product 57.3
Reading 56.3

Microsoft
created on 2022-01-28

text 98.8
indoor 86.7
black and white 84.9

Face analysis

Amazon

Google

AWS Rekognition

Age 7-17
Gender Male, 97.4%
Calm 95.3%
Angry 1.5%
Disgusted 1%
Sad 1%
Surprised 0.7%
Fear 0.2%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 9-17
Gender Female, 99.2%
Calm 99.9%
Sad 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%
Happy 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Couch 67.3%

Captions

Microsoft

a man sitting in a chair 83%
a man sitting on a table 69.4%
a man in a suit and tie 69.3%

Text analysis

Amazon

MJIR
2
YT3RA8
MJIR YT3RA8 ООЗИА
If
ООЗИА
ICOSA

Google

MJI3 YT3RA& 092MA
YT3RA&
092MA
MJI3