Human Generated Data

Title

Watching Oprah, Athens Greece
Date

2004, printed 2018
People

Artist: Jim Goldberg, American born 1953
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Francis H. Burr Memorial Fund, 2019.103
Copyright

© Jim Goldberg; courtesy Pace/MacGill Gallery, New York

Human Generated Data

Title

Watching Oprah, Athens Greece

People

Artist: Jim Goldberg, American born 1953

Date

2004, printed 2018

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-19

Human 99.7
Person 99.7
Sitting 99.2
Person 99.1
Person 98.8
Home Decor 93.9
Floor 90.9
Flooring 89
Clothing 82.1
Apparel 82.1
Door 81.3
Furniture 81
Couch 72.9
Chair 71.2
Sliding Door 63
Wood 61.1
Plywood 61.1
Display 59.7
Monitor 59.7
Screen 59.7
LCD Screen 59.7
Electronics 59.7
Flagstone 58.3
Cafe 56
Restaurant 56
Indoors 55.4
Room 55.4
Waiting Room 55.3

Clarifai
created on 2019-04-19

chair 97.2
people 97.1
furniture 96.9
room 95.6
table 94.5
seat 94.5
indoors 91.3
architecture 90.9
window 90.5
family 89.9
landscape 88.7
business 88.5
exhibition 88.2
city 87.9
street 87.8
home 87.6
man 87
building 86.7
museum 86.7
woman 85.5

Imagga
created on 2019-04-19

patio 59.9
area 44.6
structure 34.4
chair 34.2
barbershop 31.9
shop 28.5
door 23.3
room 20.7
house 20
mercantile establishment 19.6
interior 19.4
sliding door 19.2
sitting 18.9
home 17.5
seat 17.4
indoors 16.7
table 15.6
furniture 14.8
relaxation 14.2
man 14.1
adult 14
person 13.7
luxury 13.7
office 13.2
place of business 13.1
window 12.9
people 12.8
women 12.6
hairdresser 12.4
wood 11.7
movable barrier 11.5
living 11.4
male 11.3
building 11.3
modern 11.2
floor 11.1
wall 11.1
architecture 10.9
business 10.9
lifestyle 10.8
chairs 9.8
old 9.7
style 9.6
residential 9.6
outdoor 9.2
holding 9.1
summer 9
outdoors 9
businessman 8.8
light 8.7
barrier 8.6
comfortable 8.6
men 8.6
togetherness 8.5
design 8.4
relax 8.4
leisure 8.3
relaxing 8.2
smiling 8
urban 7.9
couple 7.8
casual clothing 7.8
empty 7.7
sofa 7.7
beach 7.6
enjoyment 7.5
city 7.5
inside 7.4
occupation 7.3
decoration 7.2
color 7.2
sea 7

Google
created on 2019-04-19

Wall 82.3
Room 81.5
Furniture 76.7
Door 74.5
Sitting 72.9
Architecture 72.6
Chair 72.1
House 68.3
Window 67.7
Interior design 67
Visual arts 62.5
Floor 58.9
Table 58.6
Art 58.1
Building 57
Tints and shades 56
Glass 53.8
Street 51.1

Microsoft
created on 2019-04-19

room 75.3
scene 72.5
street 72.5
person 27.5
art 21.9
summer 19.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.3%
Surprised 1.4%
Sad 41.9%
Happy 0.5%
Angry 16.9%
Disgusted 20.1%
Calm 11.2%
Confused 8%

AWS Rekognition

Age 38-59
Gender Male, 54.3%
Angry 46.1%
Sad 50.5%
Calm 47.8%
Happy 45.2%
Disgusted 45.1%
Surprised 45.2%
Confused 45.2%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Chair 71.2%

Captions

Microsoft

a person sitting on a bench in front of a building 44.5%
a person sitting on a bench in front of a building 32.5%
a person sitting in a room 32.4%