Human Generated Data

Title

Untitled (people with building plans, Bayside, Florida)

Date

1971, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.244

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people with building plans, Bayside, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1971, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.7
Person 99.7
Person 99.5
Person 99.1
Person 99
Person 98.8
Clothing 98.5
Apparel 98.5
Accessories 93.9
Tie 93.9
Accessory 93.9
People 85.4
Car 80.1
Automobile 80.1
Transportation 80.1
Vehicle 80.1
Shorts 75
Military Uniform 73.7
Military 73.7
Meal 72.9
Food 72.9
Pants 68.5
Female 67.3
Face 66.4
Soldier 63.7
Sleeve 63.4
Outdoors 62.6
Officer 62.2
Long Sleeve 61.6
Photography 58.8
Photo 58.8
Army 58.7
Armored 58.7
Soil 56.9
Tree 56.7
Plant 56.7
Woman 55.3

Imagga
created on 2022-01-08

waiter 38.4
man 34.2
person 34.1
people 34
male 32.6
dining-room attendant 30.8
employee 25.2
brass 24.7
happy 23.8
together 22.8
worker 22.7
wind instrument 22.3
musical instrument 20.7
adult 19.4
men 18.9
business 18.2
trombone 18.2
smiling 18.1
group 17.7
businessman 17.6
portrait 17.5
couple 17.4
family 16.9
meeting 16
smile 15.7
boy 15.6
teacher 15.6
team 15.2
walking 15.1
child 14.8
corporate 14.6
women 14.2
happiness 14.1
performer 14
dancer 14
executive 13.8
success 13.7
businesswoman 13.6
two 13.5
outdoors 13.4
day 13.3
teamwork 13
full length 12.6
work 12.5
job 12.4
standing 12.2
table 12.1
office 12
professional 11.9
lifestyle 11.6
kid 11.5
cheerful 11.4
father 10.9
suit 10.8
teenage 10.5
mother 10.5
sitting 10.3
beach 10.1
teen 10.1
playing 10
children 10
holding 9.9
fun 9.7
kids 9.4
room 9.2
outdoor 9.2
successful 9.1
city 9.1
modern 9.1
entertainer 9
new 8.9
home 8.8
grass 8.7
boss 8.6
life 8.6
walk 8.6
laughing 8.5
black 8.4
human 8.2
teenager 8.2
active 8.1
educator 8.1
chair 8
to 8
love 7.9
barrow 7.8
pretty 7.7
old 7.7
winter 7.7
sky 7.6
daughter 7.6
ethnic 7.6
enjoying 7.6
communication 7.5
friends 7.5
joy 7.5
one 7.5
manager 7.4
girls 7.3
dad 7.3
student 7.2
holiday 7.2
summer 7.1

Google
created on 2022-01-08

Tree 87.8
Adaptation 79.4
Plant 76.6
Vintage clothing 73.5
Event 70.9
Chair 68.3
Hat 65.6
Recreation 65.5
Monochrome 63.8
Monochrome photography 63.6
Crew 63.5
Stock photography 62.2
Room 61.8
History 61.2
Photo caption 59.6
Sky 58.2
Table 57.7
Motor vehicle 57.5
Classic 55.8
Photographic paper 53.2

Microsoft
created on 2022-01-08

outdoor 99.6
person 98.8
tree 98.5
clothing 94.8
man 94
text 93.6
smile 75
people 73.7
posing 50.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 59-67
Gender Male, 100%
Confused 80.5%
Calm 11%
Disgusted 2.9%
Sad 2.4%
Happy 1.3%
Fear 0.7%
Angry 0.7%
Surprised 0.4%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Disgusted 43.6%
Happy 27.2%
Angry 19.3%
Confused 3%
Sad 2.2%
Fear 2%
Calm 1.8%
Surprised 0.9%

AWS Rekognition

Age 20-28
Gender Female, 93.7%
Happy 97.6%
Surprised 0.8%
Calm 0.7%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 51-59
Gender Female, 99.4%
Happy 99%
Calm 0.2%
Fear 0.2%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%

AWS Rekognition

Age 42-50
Gender Male, 100%
Happy 66.5%
Calm 12.6%
Surprised 7.7%
Confused 4.1%
Fear 3.7%
Disgusted 2.9%
Sad 1.3%
Angry 1.1%

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 93.9%
Car 80.1%

Captions

Microsoft

a group of people posing for a photo 96.6%
a group of people posing for the camera 96.5%
a group of people posing for a picture 96.4%

Text analysis

Amazon

COASTAL
HOMES
CORPORATION
SARASOTA
CALL
FOR
FOR INFORMATION CALL
INFORMATION
922-4411
BUILDERS
PINECREST
ST
3507 PINECREST ST
3507
BUILDERS CUSTOM
CUSTOM
PREPLANNE
SAMPLE PREPLANNE
SAMPLE

Google

COASTAL HOMES CORPORATION E LANNED DESISNED HOME 3507 PINECREST ST SARASOTA FOR INFORMATION CALL 922-44||
E
DESISNED
922-44||
HOMES
HOME
CORPORATION
LANNED
PINECREST
ST
FOR
COASTAL
3507
SARASOTA
INFORMATION
CALL