Human Generated Data

Title

Untitled (children with cerebral palsy in physical therapy at clinic)
Date

1959
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8078
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (children with cerebral palsy in physical therapy at clinic)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.7
Human 99.7
Person 98.5
Person 97.7
Interior Design 87.9
Indoors 87.9
Female 80.9
Shorts 77.1
Clothing 77.1
Apparel 77.1
Child 73.3
Kid 73.3
Girl 73
Food 72.4
Cake 72.4
Creme 72.4
Dessert 72.4
Cream 72.4
Icing 72.4
Furniture 67.5
Face 67.5
Photo 64.3
Photography 64.3
Portrait 64.3
People 63.2
Play 60.3
Room 60.1
Handrail 58.7
Banister 58.7
Head 55.1

Imagga
created on 2022-01-15

blackboard 51.1
shopping cart 43.1
handcart 34
wheeled vehicle 26.9
man 25.5
male 24.1
people 21.7
person 20.3
container 18.5
business 16.4
teacher 15.3
businessman 15
adult 13.2
human 12.7
chart 12.4
black 11.4
hand 11.4
education 11.3
drawing 11.2
work 11
silhouette 10.8
job 10.6
sign 10.5
modern 10.5
group 10.5
success 10.5
men 10.3
classroom 10.2
sport 10.1
board 9.9
suit 9.9
office 9.6
diagram 9.6
conveyance 9.3
room 9.1
holding 9.1
design 9
technology 8.9
happy 8.8
building 8.8
symbol 8.7
newspaper 8.7
product 8.6
occupation 8.2
transport 8.2
lady 8.1
child 8.1
stage 8
idea 8
looking 8
architecture 7.8
teaching 7.8
portrait 7.8
class 7.7
crowd 7.7
graph 7.7
old 7.7
boss 7.6
walk 7.6
dance 7.5
dark 7.5
city 7.5
event 7.4
world 7.4
school 7.4
back 7.3
speed 7.3
indoor 7.3
student 7.2
lifestyle 7.2
transportation 7.2
activity 7.2
financial 7.1
women 7.1
market 7.1
interior 7.1
day 7.1
creation 7

Google
created on 2022-01-15

Black-and-white 85.6
Style 83.9
Monochrome photography 76.1
Monochrome 75.4
Font 74.1
Room 63.5
Stock photography 62.7
Vintage clothing 61.7
Street 60
Visual arts 55.3
Rectangle 54.2
Photographic paper 53.4
Circle 53.3
Advertising 52.9
Illustration 52
Pattern 50.6

Microsoft
created on 2022-01-15

text 98.9
clothing 95
person 93.3
outdoor 87.4
footwear 85
black and white 78

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 94.4%
Happy 89%
Calm 5.1%
Surprised 2.1%
Sad 1.2%
Fear 0.8%
Angry 0.8%
Disgusted 0.5%
Confused 0.5%

AWS Rekognition

Age 26-36
Gender Male, 98.3%
Happy 67.6%
Calm 31.1%
Sad 0.3%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Female, 89.1%
Happy 60.6%
Surprised 25.4%
Calm 8.3%
Angry 2.1%
Fear 1.5%
Confused 1%
Sad 0.6%
Disgusted 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a bus 39.8%
a group of baseball players that are standing in the street 39.7%
a group of baseball players standing on a street 39.6%

Text analysis

Amazon

UNITED
PALSY
CEREBRAL
CEREBRAL PALSY
44468
P
C
NAOOS
COVEEIA-ETTW

Google

8
CEREBRAL
4-44(o 8 UNITED CEREBRAL UNITED PALSY CEREBRAL PALSY
UNITED
PALSY
4-44(o