Human Generated Data

Title

Untitled (five women sitting in living room)

Date

c. 1950

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21628

Human Generated Data

Title

Untitled (five women sitting in living room)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.5
Human 99.5
Person 98.9
Person 98.4
Furniture 98.3
Person 98.2
Person 97.9
Indoors 92
Table 88.1
Monitor 87.8
Screen 87.8
Display 87.8
Electronics 87.8
LCD Screen 87.4
Desk 83.8
Couch 83.1
Pc 80.4
Computer 80.4
Shelf 79.3
Room 75.5
Advertisement 75.4
Poster 75.4
Collage 75.4
Living Room 71.3
Office 67.4
Person 65.7
Tabletop 57.3
Sitting 56

Imagga
created on 2022-03-05

salon 55.2
room 38
interior 31.8
table 29.2
modern 28.7
shop 28.4
chair 27.4
people 24.5
restaurant 23.7
classroom 23.6
barbershop 23.2
business 22.5
indoors 22
person 21.8
man 21.5
design 20.8
office 19.7
furniture 19.3
male 18.4
mercantile establishment 16.6
businessman 15.9
house 15.9
home 15.1
meeting 15.1
indoor 14.6
group 14.5
light 14
floor 13.9
men 13.7
window 13.7
computer 13.7
work 13.3
lifestyle 13
inside 12.9
sitting 12.9
blackboard 12.9
adult 12.8
board 12.7
decor 12.4
education 12.1
corporate 12
desk 12
place of business 12
professional 11.9
style 11.9
women 11.9
counter 11.8
architecture 11.7
glass 11.7
teacher 11.5
contemporary 11.3
executive 11.2
coffee 11.1
horizontal 10.9
decoration 10.9
chairs 10.8
job 10.6
comfortable 10.5
empty 10.3
luxury 10.3
service 10.2
center 10.1
elegance 10.1
building 9.5
laptop 9.3
space 9.3
teamwork 9.3
communication 9.2
case 9
team 9
life 8.9
tables 8.9
conference 8.8
happy 8.8
hairdresser 8.7
class 8.7
structure 8.6
dining 8.6
cafeteria 8.5
living 8.5
food 8.5
seat 8.5
relaxation 8.4
mature 8.4
wood 8.3
bar 8.3
silhouette 8.3
occupation 8.2
kitchen 8.2
businesswoman 8.2
technology 8.2
domestic 8.1
handsome 8
working 7.9
black 7.8
nobody 7.8
residential 7.7
sofa 7.7
lamp 7.6
equipment 7.5
monitor 7.5
worker 7.2
establishment 7.2
smile 7.1

Google
created on 2022-03-05

Photograph 94.2
Plant 89.8
Black 89.8
Black-and-white 87.2
Style 84.1
Line 81.7
Font 79.4
Window 79.4
Rectangle 78.9
Monochrome 77.1
Monochrome photography 77
Beauty 74.9
Building 74.3
Snapshot 74.3
Room 72
Art 69.4
Chair 68.9
Design 68.4
Machine 66.4
T-shirt 64.9

Microsoft
created on 2022-03-05

window 98
person 95.3
text 93.9
indoor 91.2
furniture 91
clothing 90.7
computer 89.3
desk 70.9
chair 63
man 62.9
table 26.1

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 96.7%
Calm 97.6%
Surprised 0.8%
Disgusted 0.6%
Confused 0.3%
Fear 0.3%
Happy 0.2%
Sad 0.1%
Angry 0.1%

AWS Rekognition

Age 34-42
Gender Male, 93.4%
Sad 94.1%
Calm 5%
Fear 0.4%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Surprised 65.6%
Calm 31.2%
Happy 1.6%
Fear 0.6%
Sad 0.3%
Disgusted 0.3%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 42-50
Gender Male, 93.9%
Happy 61.1%
Surprised 17.3%
Calm 13.9%
Sad 2.9%
Fear 1.3%
Confused 1.2%
Disgusted 1.2%
Angry 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people sitting at a table in front of a window 83.8%
a group of people sitting at a desk in front of a window 83.7%
a group of people standing in front of a window 83.6%

Text analysis

Amazon

5-551