Human Generated Data

Title

Untitled (hospital patients in wheelchairs)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16009

Human Generated Data

Title

Untitled (hospital patients in wheelchairs)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Person 99.7
Human 99.7
Furniture 99.6
Chair 99.6
Person 99
Person 96.8
Person 96.4
Wheel 95.3
Machine 95.3
Person 94.6
Wheel 94.5
Person 93.4
Person 91.9
Vehicle 90.5
Transportation 90.5
Bicycle 90.5
Bike 90.5
Bicycle 74.3
Bicycle 67.9
Wheel 63.7
Wheel 60.8
Display 59
Monitor 59
Electronics 59
Screen 59
Wheelchair 57

Imagga
created on 2022-03-25

sliding door 88.8
door 78.7
movable barrier 53.8
barrier 36.7
interior 30.9
window 28.4
home 24.7
room 24.1
modern 23.1
sketch 22.1
house 21.7
architecture 19.5
chair 18.4
drawing 18.3
obstruction 18
design 17.4
light 16.7
building 16.1
floor 15.8
indoor 15.5
3d 14.7
wood 14.2
indoors 14
table 14
wall 13.7
inside 12.9
glass 12.4
decor 12.4
living 12.3
furniture 11.8
representation 11.7
city 11.6
residential 11.5
urban 11.3
street 11
business 10.9
apartment 10.5
decoration 10.3
luxury 10.3
shop 9.9
transportation 9.9
old 9.7
lamp 9.5
transport 9.1
living room 8.8
empty 8.6
construction 8.5
estate 8.5
people 8.4
structure 8.4
style 8.2
lifestyle 7.9
residence 7.8
nobody 7.8
industry 7.7
stone 7.7
sofa 7.6
seat 7.6
row 7.4
bedroom 7.2
color 7.2
vehicle 7.2
working 7.1

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

text 95.4
window 92.7
indoor 88.1
person 77.9
wheel 64.9
bicycle 59.9
furniture 25.6

Face analysis

Amazon

Google

AWS Rekognition

Age 2-10
Gender Male, 98.8%
Calm 89.5%
Sad 6.6%
Disgusted 1.3%
Confused 1.1%
Fear 0.4%
Happy 0.4%
Angry 0.4%
Surprised 0.3%

AWS Rekognition

Age 52-60
Gender Male, 99.7%
Calm 57.3%
Sad 37.7%
Fear 3.3%
Confused 0.6%
Disgusted 0.5%
Angry 0.2%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Female, 61.1%
Calm 73.2%
Sad 9.7%
Happy 8.7%
Angry 2.9%
Disgusted 2.2%
Confused 1.7%
Fear 1%
Surprised 0.7%

AWS Rekognition

Age 20-28
Gender Male, 57.5%
Calm 90.7%
Confused 2.4%
Sad 2.2%
Surprised 1.7%
Angry 1.2%
Disgusted 0.9%
Happy 0.8%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 50.6%
Confused 71%
Angry 12.9%
Sad 6.8%
Calm 3%
Disgusted 2.2%
Happy 1.8%
Surprised 1.4%
Fear 0.8%

AWS Rekognition

Age 21-29
Gender Female, 93.4%
Calm 91.8%
Happy 2.9%
Sad 1.9%
Confused 1.3%
Angry 1%
Surprised 0.4%
Fear 0.4%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Wheel 95.3%
Bicycle 90.5%

Captions

Microsoft

a vintage photo of some people in a room 92.6%
a vintage photo of a group of people in a room 89.9%
a vintage photo of some people that are standing in a room 83.3%

Text analysis

Amazon

KODAK
SAFETY
SAFETY FILM
FILM
8
S

Google

KODAK
KODAK S'AFETY FILM KODAK
FILM
S'AFETY