Human Generated Data

Title

Untitled (young man on crutches with nurse)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15565

Human Generated Data

Title

Untitled (young man on crutches with nurse)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 99.5
Person 99.5
Room 90.3
Indoors 90.3
Clothing 87.9
Apparel 87.9
Shoe 87.9
Footwear 87.9
Person 86.4
Shoe 84.3
Door 75.8
Bathroom 75.2
Shower 67.2
Floor 63.3
Shorts 62.5
Clinic 57.4
Flooring 55.1

Imagga
created on 2022-02-05

door 43.4
sliding door 41.3
interior 30.9
room 27.2
movable barrier 26.6
house 25.9
window 25
modern 23.1
home 23.1
light 20.7
barrier 19.2
wall 18.1
furniture 15.6
indoors 14.9
architecture 14.8
glass 14.8
kitchen 14.6
chair 14.4
indoor 13.7
shop 13
inside 12.9
luxury 12.9
device 12.6
design 12.4
table 12.3
floor 12.1
building 12
apartment 11.5
decor 11.5
person 11.2
people 11.2
man 10.7
women 10.3
3d 10.1
cabinet 10
locker 9.9
doors 9.8
adult 9.8
metal 9.7
decoration 9.4
lifestyle 9.4
office 9.4
equipment 9.3
obstruction 9.3
hospital 8.7
lamp 8.7
refrigerator 8.6
business 8.5
portrait 8.4
elegance 8.4
wood 8.3
barbershop 8.3
city 8.3
fastener 8.1
sexy 8
standing 7.8
male 7.8
old 7.7
fashion 7.5
contemporary 7.5
new 7.3
stylish 7.2
black 7.2
open 7.2

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

text 96.4
black and white 90.5
man 90.1
person 90
standing 83.5
stairs 72
clothing 61.6
ladder 51.4
posing 39.7
net 21.3

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 98.8%
Disgusted 0.5%
Surprised 0.2%
Fear 0.1%
Sad 0.1%
Angry 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 23-31
Gender Female, 84.7%
Sad 51.1%
Angry 12.2%
Calm 11.3%
Surprised 7.2%
Fear 5.6%
Confused 5.5%
Happy 4.8%
Disgusted 2.4%

AWS Rekognition

Age 18-24
Gender Female, 78.2%
Calm 36.5%
Happy 32.7%
Sad 10.5%
Fear 8%
Disgusted 6.4%
Angry 2.8%
Surprised 1.6%
Confused 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 87.9%

Captions

Microsoft

a person standing in front of a building 80.6%
a person standing in front of a window 72.8%
a man and a woman standing in front of a building 58.9%