Human Generated Data

Title

Untitled (adults and children gathered around mule with cart)
Date

1969
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11311
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (adults and children gathered around mule with cart)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1969

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Wheel 99.7
Machine 99.7
Person 97.1
Human 97.1
Person 95.7
Person 88.6
Person 88.5
Person 87.5
People 87.2
Person 86.4
Person 79.3
Horse 78.9
Animal 78.9
Mammal 78.9
Person 78.8
Person 78.3
Person 77.6
Person 77.2
Person 72
Person 71.5
Person 70.1
Outdoors 68.6
Clothing 66.7
Apparel 66.7
Building 65.7
Clinic 64.5
Person 63.4
Funeral 57

Imagga
created on 2022-01-09

dairy 33.3
plow 21.5
horse cart 17.6
sky 17.2
tool 16.3
cart 16
horse 15.9
travel 14.8
wagon 14.3
farm 14.3
landscape 14.1
industrial 13.6
vehicle 13.1
building 12.8
water 12.7
military 12.6
tourism 12.4
cattle 12.3
black 12
old 11.8
sea 11.7
city 11.6
history 11.6
wheeled vehicle 11.5
rural 11.4
man 11.4
danger 10.9
gun 10.5
grass 10.3
industry 10.2
architecture 10.2
beach 10.1
field 10
pen 10
coast 9.9
transportation 9.9
rifle 9.5
scene 9.5
male 9.2
house 9.2
protection 9.1
summer 9
sand 8.9
cannon 8.8
soldier 8.8
toxic 8.8
horses 8.8
nuclear 8.7
mask 8.6
tree 8.5
outdoor 8.4
enclosure 8.3
island 8.2
environment 8.2
outdoors 8.2
dirty 8.1
cow 8.1
structure 8
country 7.9
destruction 7.8
protective 7.8
animal 7.8
stone 7.8
war 7.7
chemical 7.7
gas 7.7
sculpture 7.6
clouds 7.6
bay 7.5
smoke 7.4
vacation 7.4
transport 7.3
artillery 7.2
sunset 7.2
livestock 7.2
bovine 7.1
day 7.1

Google
created on 2022-01-09

Vehicle 87
Adaptation 79.4
Working animal 77
Wheel 76.8
Art 72.6
Painting 72.3
Motor vehicle 71.2
Photo caption 70.7
Picture frame 70.3
Pack animal 68.1
History 67.6
Pole 67.5
Font 66.4
Vintage clothing 64.6
Paper product 64.1
Room 62.7
Illustration 62.7
Stock photography 62.5
Rolling stock 62
Photographic paper 61.1

Microsoft
created on 2022-01-09

text 99.4
outdoor 97.9
horse 93.5
old 93.3
white 82.6
black 81.5
team 73.5
pulling 64.7
drawn 63.7
person 50
carriage 35.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 90.5%
Sad 89.9%
Fear 2.3%
Calm 2.2%
Confused 1.8%
Happy 1.2%
Disgusted 1.2%
Surprised 0.8%
Angry 0.7%

AWS Rekognition

Age 51-59
Gender Male, 92.9%
Calm 73.9%
Confused 11.7%
Disgusted 4%
Happy 3%
Sad 2.6%
Surprised 2%
Angry 1.8%
Fear 0.9%

AWS Rekognition

Age 18-26
Gender Male, 91.9%
Calm 73.1%
Sad 17.3%
Confused 5%
Fear 1.9%
Happy 0.8%
Angry 0.8%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 31-41
Gender Female, 90.8%
Happy 81.7%
Sad 9.3%
Confused 3.4%
Calm 2.4%
Surprised 1.3%
Angry 0.8%
Disgusted 0.7%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Wheel 99.7%
Person 97.1%
Horse 78.9%

Captions

Microsoft

a vintage photo of a man riding a horse drawn carriage 87.9%
a vintage photo of a horse drawn carriage 87.8%
a vintage photo of a horse drawn carriage in front of a building 87.7%

Text analysis

Amazon

FLORIDA
STEINMETZ, SARASOTA, FLORIDA
STEINMETZ,
SARASOTA,
57170.
e..........
RAGOS
MJ17--YT33A'2

Google

37170. STEINMETZ, SARASOTA, FLORIDA
37170.
STEINMETZ,
SARASOTA,
FLORIDA