Human Generated Data

Title

Untitled (a Nawab?)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.80

Human Generated Data

Title

Untitled (a Nawab?)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.80

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 99.8
Human 99.8
Person 99.6
Person 99.4
Person 99.1
Person 98.7
Person 96.6
People 93.4
Person 93.1
Person 92.9
Person 88.9
Person 82.5
Person 80.6
Person 76.3
Person 74.2
Crowd 74
Person 73.1
Person 71.2
Painting 69.9
Art 69.9
Family 59.9
Military 57.7
Military Uniform 57.7
Clothing 56
Apparel 56
Person 49

Clarifai
created on 2018-10-19

people 100
group 99.5
many 99.3
adult 99.1
group together 97.9
man 95.1
war 94.9
woman 94.7
military 94.5
wear 94.3
child 92.6
administration 91.7
outfit 88.9
boy 86.5
soldier 86
spectator 83.5
several 82.7
music 82.3
skirmish 81.2
gun 80.7

Imagga
created on 2018-10-19

brass 39
wind instrument 33.3
musical instrument 31.1
trombone 28.3
uniform 24.1
people 22.9
man 21.5
weapon 18.8
military uniform 17.8
clothing 17.1
male 16.3
person 13.9
outdoor 13.8
sport 13.5
military 13.5
two 12.7
war 12.5
adult 12.4
silhouette 12.4
walking 12.3
men 12
outdoors 11.9
summer 10.3
women 10.3
active 10.2
leisure 10
vacation 9.8
old 9.7
black 9.6
couple 9.6
holiday 9.3
field 9.2
travel 9.1
family 8.9
group 8.9
soldier 8.8
together 8.8
play 8.6
outside 8.6
child 8.5
stringed instrument 8.5
protection 8.2
danger 8.2
life 8.2
banjo 8.2
private 8.1
history 8
lifestyle 7.9
day 7.8
happiness 7.8
boy 7.8
warrior 7.8
sky 7.6
walk 7.6
statue 7.6
horse 7.6
covering 7.6
bugle 7.5
fun 7.5
mother 7.4
holding 7.4
park 7.4
tradition 7.4
world 7.3
consumer goods 7.3
girls 7.3
tourist 7.2
recreation 7.2
activity 7.2
grass 7.1
love 7.1

Google
created on 2018-10-19

Microsoft
created on 2018-10-19

person 99.9
outdoor 99.5
group 97.7
posing 97.4
standing 95.6
old 93.6
people 93.1
sport 73.3
white 62.5
vintage 36.8
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 56.4%
Confused 2.3%
Happy 1%
Calm 25.9%
Disgusted 8%
Angry 4.9%
Sad 56.1%
Surprised 1.8%

AWS Rekognition

Age 26-43
Gender Male, 94.1%
Angry 2.4%
Disgusted 2.3%
Sad 9.9%
Happy 5.3%
Confused 1.8%
Calm 74.3%
Surprised 3.9%

AWS Rekognition

Age 26-44
Gender Male, 78.7%
Disgusted 6.3%
Sad 12.7%
Confused 5%
Angry 7%
Happy 4.4%
Calm 58.9%
Surprised 5.8%

AWS Rekognition

Age 26-44
Gender Male, 96.5%
Calm 79.9%
Disgusted 1.4%
Confused 2.3%
Sad 3.4%
Angry 10.2%
Happy 1.2%
Surprised 1.8%

AWS Rekognition

Age 26-43
Gender Male, 95.7%
Sad 33.6%
Confused 5.9%
Angry 5.1%
Disgusted 1.4%
Happy 0.8%
Surprised 1.5%
Calm 51.7%

AWS Rekognition

Age 20-38
Gender Female, 89.2%
Confused 0.5%
Angry 2.3%
Surprised 0.5%
Calm 0.8%
Disgusted 0.8%
Happy 0.5%
Sad 94.6%

AWS Rekognition

Age 35-53
Gender Female, 66.7%
Sad 85.3%
Confused 1.7%
Disgusted 5.4%
Happy 1.6%
Angry 1.6%
Calm 3.3%
Surprised 1.1%

AWS Rekognition

Age 35-52
Gender Male, 75.7%
Confused 4.6%
Disgusted 1.9%
Sad 41.4%
Angry 10%
Calm 36.1%
Happy 3.2%
Surprised 2.9%

AWS Rekognition

Age 26-44
Gender Male, 92.7%
Disgusted 4.6%
Happy 6.7%
Surprised 5.4%
Sad 30.4%
Calm 25.2%
Angry 13.1%
Confused 14.5%

AWS Rekognition

Age 26-43
Gender Male, 99.1%
Angry 5.5%
Surprised 4.2%
Calm 41.8%
Sad 35.7%
Disgusted 2.1%
Confused 8.3%
Happy 2.4%

AWS Rekognition

Age 26-43
Gender Female, 68.2%
Confused 1.2%
Disgusted 4.5%
Calm 63%
Sad 16.6%
Surprised 2.7%
Happy 5.1%
Angry 6.8%

AWS Rekognition

Age 26-43
Gender Female, 72.3%
Sad 67.8%
Angry 8%
Disgusted 4.5%
Calm 6.6%
Surprised 3.7%
Happy 6.1%
Confused 3.3%

AWS Rekognition

Age 26-43
Gender Female, 70.4%
Sad 51.3%
Disgusted 4.2%
Angry 4.3%
Happy 16.1%
Confused 3.9%
Surprised 2.8%
Calm 17.4%

AWS Rekognition

Age 57-77
Gender Female, 69.9%
Surprised 3.2%
Calm 25.9%
Angry 13.4%
Sad 15%
Happy 21.4%
Confused 2.8%
Disgusted 18.3%

AWS Rekognition

Age 48-68
Gender Male, 77.2%
Angry 9%
Disgusted 2.6%
Happy 14.7%
Calm 29.7%
Sad 35.4%
Confused 4.6%
Surprised 4.1%

AWS Rekognition

Age 30-47
Gender Male, 53.1%
Disgusted 45.4%
Happy 45.2%
Surprised 45.5%
Sad 51.6%
Calm 46.4%
Angry 45.7%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 87.7%
Sad 5%
Confused 0.7%
Angry 1.1%
Disgusted 0.5%
Happy 0.5%
Surprised 0.7%
Calm 91.5%

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 69.9%

Captions

Azure OpenAI

Created by gpt-4 on 2024-11-18

This is a historical black-and-white photograph showing a group of individuals who appear to be posing. The attire suggests a mix of traditional and possibly military influence, with some individuals holding rifles. There is a variety of clothing styles, including robes and tunics with intricate patterns, headwraps, and sashes. The photo is marked with some signs of age, like spots, scratches, and faded areas, which is typical of old photographs. It could potentially be from a cultural or historical documentation, given the formal arrangement of the subjects and the diversity of dress. The backdrop of the image is outdoors, with trees and foliage that are not in sharp focus.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-11-18

This appears to be a historical photograph depicting a group of indigenous people from what seems to be a tribal or ethnic minority community. The individuals are dressed in traditional garments and headdresses, and some are holding what appear to be weapons or tools. They are standing together outdoors in a natural setting with trees and foliage visible in the background. The image has a sepia-toned, vintage aesthetic, suggesting it was likely taken some time in the past, possibly during a colonial or exploration period. The photograph provides a glimpse into the lives and culture of this particular community, though without further context, I cannot make any definitive claims about their specific identity or location.

Meta Llama

Created on 2024-12-01

The image is a sepia-toned photograph of a group of men, likely from India or the Indian subcontinent, posing for a portrait. The men are dressed in traditional attire, with some wearing turbans and others in long robes or dhotis. Some of the men are holding swords or other weapons, while others have their hands clasped together in front of them. In the foreground, a man sits on a chair or stool, wearing a dark robe with intricate embroidery and a turban. He holds a sword in his right hand and has a cane in his left hand. Behind him, several other men stand, some of whom are also holding swords or other weapons. The background of the image is blurry, but it appears to be a natural setting, possibly outdoors. There are trees and foliage visible behind the group of men, suggesting that the photo was taken in a park or other outdoor location. Overall, the image suggests that the men in the photo are members of a royal or noble family, or perhaps a group of warriors or soldiers. The formal attire and the presence of swords and other weapons suggest a sense of importance and authority.