Human Generated Data

Title

Untitled (young people studying on beds and at desk in room)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14776

Human Generated Data

Title

Untitled (young people studying on beds and at desk in room)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Furniture 99.5
Person 98
Human 98
Person 97.7
Person 96.6
Person 90.5
Bed 82.1
Flooring 75.1
Person 73.4
Person 72.5
Indoors 62.9
Bed 62.4
Room 62.4
Floor 57.8
Cradle 56
Door 55.4

Imagga
created on 2022-01-29

room 70.9
hospital 39.8
interior 38.1
table 37
home 35.1
furniture 33.8
desk 32.9
bedroom 32.2
office 30.8
computer 28.5
indoors 28.2
modern 28.1
house 26.8
work 23.6
people 22.9
person 22.4
laptop 21.9
chair 21
indoor 20.1
man 19.5
working 19.5
sitting 18.9
business 18.9
studio apartment 18.7
patient 17.8
design 17.5
bed 17.1
classroom 17
monitor 16.8
decor 16.8
inside 16.6
male 16.3
floor 15.8
adult 15.7
wood 15
technology 14.9
professional 14.8
luxury 14.6
comfortable 14.3
pillow 13.6
lifestyle 13
corporate 12.9
kitchen 12.7
living 12.3
light 12
style 11.9
relaxation 11.7
smiling 11.6
businessman 11.5
window 11.5
lamp 11.5
sofa 11.4
men 11.2
equipment 11.1
relax 11
communication 10.9
decoration 10.9
apartment 10.6
contemporary 10.4
empty 10.3
color 10
decorating 9.7
success 9.7
residential 9.6
hotel 9.6
women 9.5
meeting 9.4
rest 9.4
service 9.3
executive 9.2
horizontal 9.2
occupation 9.2
relaxing 9.1
portrait 9.1
team 9
worker 8.9
job 8.9
happy 8.8
sleeping 8.8
wall 8.7
couch 8.7
clinic 8.7
notebook 8.7
architecture 8.6
workplace 8.6
seat 8.5
restaurant 8.1
group 8.1
medical 8
wooden 7.9
motel 7.9
smile 7.8
chairs 7.8
living room 7.8
carpet 7.8
nobody 7.8
space 7.8
furnishing 7.8
comfort 7.7
using 7.7
health 7.7
illness 7.6
talking 7.6
keyboard 7.6
clean 7.5
case 7.5
manager 7.5
document 7.4
phone 7.4
treatment 7.4
businesswoman 7.3
center 7.1
medicine 7.1
together 7
glass 7

Google
created on 2022-01-29

Black 89.8
Comfort 88.1
Black-and-white 83.5
Picture frame 82.1
Bed frame 78.1
Snapshot 74.3
Monochrome photography 74.2
Bed 74.2
Rectangle 73.1
Monochrome 72.3
Room 71.4
Building 70.5
Linens 68.4
Bedding 66.7
Art 66.7
Stock photography 65.3
Bedroom 65.3
Pillow 60.8
Wood 58.6
Bed sheet 58.4

Microsoft
created on 2022-01-29

text 96.8
house 96.1
indoor 94.5
black and white 92.2
furniture 89.5
window 89
bed 86.5

Face analysis

Amazon

Google

AWS Rekognition

Age 53-61
Gender Female, 53.9%
Sad 96.1%
Calm 1.8%
Fear 0.7%
Angry 0.4%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Female, 81.6%
Happy 44%
Angry 22%
Surprised 18.1%
Calm 9.1%
Fear 3.7%
Disgusted 1.3%
Sad 1.1%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Bed 82.1%

Captions

Microsoft

a group of people sitting at a table in front of a window 52%
a person sitting next to a window 51.9%
a group of people looking at a book 39.9%

Text analysis

Amazon

6
XAGOX
EITW
ELASITW

Google

A°2
MJ YT37 A°2 NAGOX
MJ
YT37
NAGOX