Human Generated Data

Title

Untitled (boys talking at window)
Date

1951, printed later
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.227

Human Generated Data

Title

Untitled (boys talking at window)

People

Artist: Jack Gould, American

Date

1951, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.7
Human 99.7
Person 98.4
Lamp 95.9
Table Lamp 95.9
Furniture 75
Apparel 74.7
Shoe 74.7
Clothing 74.7
Footwear 74.7
Building 70.7
Tower 70.7
Architecture 70.7
Clock Tower 70.7
Indoors 59.7
Living Room 59.7
Room 59.7
Lampshade 57.4
Interior Design 55.7

Imagga
created on 2021-12-14

monitor 29.6
computer 29
equipment 25.7
technology 24.5
business 24.3
laptop 22
office 21.3
device 19.7
furniture 19.6
desk 19
people 19
table 18.3
working 17.7
work 17.4
modern 16.1
communication 15.1
person 14.9
home 14.3
interior 14.1
electronic equipment 13.7
room 13.2
keyboard 13.2
man 12.8
worker 12.4
support 11.5
display 11.4
fashion 11.3
sitting 11.2
professional 11
screen 11
house 10.9
lifestyle 10.8
job 10.6
chair 10.4
adult 10.4
money 10.2
attractive 9.8
machine 9.6
window 9.6
hair 9.5
home appliance 9.5
floor 9.3
appliance 9.2
seat 9.1
hand 9.1
black 9
call 9
one 9
bank 8.8
indoors 8.8
case 8.8
mouse 8.6
television 8.6
3d 8.5
finance 8.4
pretty 8.4
furnishing 8.2
brunette 7.8
corporate 7.7
shirt 7.5
white goods 7.4
dollar 7.4
service 7.4
occupation 7.3
design 7.3
success 7.2
smiling 7.2
suit 7.2
body 7.2
kitchen 7.2
smile 7.1
women 7.1
steel 7.1
businessman 7.1
dishwasher 7

Google
created on 2021-12-14

Chair 84.2
Table 83
Lamp 82.9
Black-and-white 82.3
Window 81.2
Rectangle 79.3
Font 77.8
Monochrome photography 73.9
Monochrome 72.3
Desk 72.3
Art 70.6
Room 67.6
Machine 66.4
Stock photography 64.2
Sitting 63.7
Visual arts 58.7
Lampshade 58
Still life photography 56.8
Photographic paper 55.9
Kitchen & dining room table 55.8

Microsoft
created on 2021-12-14

text 99.5
indoor 96.4
black and white 89.8
footwear 81.7
window 81.7
clothing 76
person 74.2
desk 12.5

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Female, 65%
Happy 62.8%
Calm 20%
Sad 8.9%
Confused 3.2%
Fear 2.6%
Surprised 1.2%
Angry 1%
Disgusted 0.3%

AWS Rekognition

Age 50-68
Gender Male, 57.3%
Sad 65.6%
Calm 31.2%
Happy 1%
Confused 1%
Angry 0.7%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 74.7%
Clock Tower 70.7%

Captions

Microsoft

a person sitting at a desk in front of a window 67.5%
a person sitting in front of a window 58.6%
a person sitting in front of a window 44.9%